-- Logs begin at Tue 2022-08-23 02:46:51 UTC, end at Tue 2022-08-23 04:52:45 UTC. -- Aug 23 04:19:04.296637 dv-cinder-854070-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 04:19:04.305826 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 04:19:04 2022] *** Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: nodename: dv-cinder-854070-1-iscsi Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: machine: x86_64 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: clock source: unix Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: pcre jit disabled Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: detected number of CPU cores: 4 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: current working directory: / Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: detected binary path: /usr/bin/uwsgi-core Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: your processes number limit is 47680 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: your memory page size is 4096 bytes Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: detected max file descriptor number: 2048 Aug 23 04:19:04.307797 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: lock engine: pthread robust mutexes Aug 23 04:19:04.308787 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: thunder lock: enabled Aug 23 04:19:04.308787 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 04:19:04.308787 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 04:19:04.346564 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: Python main interpreter initialized at 0x5574643269c0 Aug 23 04:19:04.346564 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: python threads support enabled Aug 23 04:19:04.346564 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: your server socket listen backlog is limited to 100 connections Aug 23 04:19:04.346564 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: your mercy for graceful operations on workers is 90 seconds Aug 23 04:19:04.346907 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 04:19:04.346987 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: *** Operational MODE: preforking *** Aug 23 04:19:04.347219 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: *** uWSGI is running in multiple interpreter mode *** Aug 23 04:19:04.347219 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: spawned uWSGI master process (pid: 105914) Aug 23 04:19:04.347412 dv-cinder-854070-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 04:19:04.348791 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: spawned uWSGI worker 1 (pid: 105915, cores: 1) Aug 23 04:19:04.348791 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: spawned uWSGI worker 2 (pid: 105916, cores: 1) Aug 23 04:19:04.348791 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 04:19:04.994250 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 04:19:05.000304 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 04:19:06.067890 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:19:06.067890 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: from cryptography.utils import int_from_bytes Aug 23 04:19:06.068654 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:19:06.068654 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: from cryptography.utils import int_from_bytes Aug 23 04:19:06.069455 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:19:06.069455 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: from cryptography.utils import int_from_bytes Aug 23 04:19:06.069911 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:19:06.069911 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: from cryptography.utils import int_from_bytes Aug 23 04:19:08.552896 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:19:08.554021 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:19:08.554021 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:19:08.554021 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:19:08.554238 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:19:08.554539 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.554886 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.555216 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.555501 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.555813 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.555969 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:19:08.556378 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.556466 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:19:08.556552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.556700 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.556859 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:19:08.557012 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.557108 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:19:08.557262 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.557349 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:19:08.557566 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.557668 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.557877 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-1-iscsi {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.557969 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558184 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558275 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558487 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558579 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558777 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.558868 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559083 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559179 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559384 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559477 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559684 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.559766 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560001 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560175 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560435 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560519 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560754 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.560948 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561055 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-1-iscsi {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561197 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561376 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561523 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561679 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561832 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.561985 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562107 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562304 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562390 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562607 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562704 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.562925 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563052 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563228 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563318 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563547 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563774 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.563976 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-1-iscsi {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564141 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564287 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564381 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564588 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564673 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564892 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.564981 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565262 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565354 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565571 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565677 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565865 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.565992 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566173 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566255 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566480 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566561 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566780 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.566912 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567095 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567178 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-1-iscsi {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567403 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567493 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567709 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.567793 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568045 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568132 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568340 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568512 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568692 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.568875 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569325 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569421 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569525 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569614 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569696 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569774 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.569946 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570048 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570180 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570366 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570484 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570683 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.570796 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571000 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571107 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571318 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571404 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571625 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571712 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571869 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.571971 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572202 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572298 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572516 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572632 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572813 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.572899 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573110 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573201 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573358 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573453 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573665 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573749 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.573970 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574071 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574262 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574363 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574560 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574650 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574830 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.574919 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575078 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575165 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575393 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575477 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575710 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.575806 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576040 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576129 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576344 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576426 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576649 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576744 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.576952 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577049 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577250 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577337 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577550 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577641 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577855 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.577940 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578153 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578242 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578461 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578555 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578768 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.578850 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579066 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579152 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579362 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579454 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579660 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579743 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.579991 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580080 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580313 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580403 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580611 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580693 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580851 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.580947 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581145 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581229 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581439 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581744 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.581827 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582039 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582124 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582332 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582415 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582627 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582708 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.582920 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583007 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583215 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583304 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583510 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583616 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583809 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.583965 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584309 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584479 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584548 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584621 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584801 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.584893 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585107 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585197 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585406 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585498 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585703 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.585786 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586002 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586083 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586300 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586392 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586595 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586676 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586891 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.586974 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587187 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587284 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587482 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587566 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587780 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.587861 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.588099 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.588632 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.588768 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.588851 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589069 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589150 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589362 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589453 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589658 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589748 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.589962 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590045 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590258 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590349 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590560 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590642 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590863 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.590954 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591149 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591238 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591449 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591539 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591753 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.591835 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592075 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592171 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592372 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592463 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592664 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592784 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.592955 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593040 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593250 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593385 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593544 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593642 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593838 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.593933 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594130 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594224 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594418 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594511 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594722 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.594817 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595030 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595121 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595324 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595425 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595618 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595703 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.595940 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596036 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596237 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596341 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596538 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596623 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.596839 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.596930 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.597154 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.597310 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.597458 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.597591 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.597721 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.597848 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.598036 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.598172 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.598351 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.598489 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.598659 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.598796 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.598961 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.599089 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.599263 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.599390 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.599568 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.599693 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:19:08.600099 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600175 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600295 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600367 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600608 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600737 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.600919 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601053 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601239 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601385 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601716 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.601859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602035 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602170 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602348 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602474 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602663 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602787 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.602988 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603094 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603310 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603403 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603609 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603708 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.603963 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604051 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604379 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604581 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604666 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604909 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.604992 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605227 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605318 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605539 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605623 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605842 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.605925 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606147 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606233 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606459 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606543 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606781 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.606862 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607082 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607163 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607392 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607484 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607693 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.607775 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608018 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608120 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608323 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608408 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608624 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608706 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.608925 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609016 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609248 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609343 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609553 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609636 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.609858 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610024 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610160 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610244 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610473 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610555 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610774 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.610868 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611075 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611158 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611458 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611672 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611756 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.611989 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612076 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612285 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612368 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612585 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612670 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612879 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.612999 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613190 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613273 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613509 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613597 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613805 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.613896 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614126 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614208 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614425 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614527 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614723 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.614815 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615024 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615120 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615343 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615427 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615650 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.615866 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616205 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616293 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616518 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616826 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.616909 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617125 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617209 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617422 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617503 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617735 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.617825 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618031 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618115 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618325 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618415 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618630 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618724 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.618931 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619014 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619230 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619320 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619530 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619620 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619831 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.619965 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620179 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620270 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620467 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620562 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620768 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.620852 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621081 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621164 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621389 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621479 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621681 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621764 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.621992 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622076 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622293 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622597 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622680 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622892 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.622975 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623191 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623279 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623485 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623568 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623781 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.623864 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624101 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624195 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624417 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624547 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624694 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624785 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.624988 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625073 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625281 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625372 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625575 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625671 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625869 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.625951 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626179 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626302 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626476 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626568 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626771 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.626855 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627064 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627147 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627356 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627447 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627686 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.627769 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628011 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628131 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628318 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628426 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628619 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628714 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.628924 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629017 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629234 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629339 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629529 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629629 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629830 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.629922 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630132 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630225 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630435 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630535 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630735 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.630835 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631090 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631366 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631718 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631800 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631877 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.631974 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632071 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632216 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632322 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632557 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632651 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632882 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.632978 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633192 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633285 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633489 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633573 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633796 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.633890 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634116 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634207 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634427 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634512 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634732 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.634819 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635042 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635124 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635342 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635425 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635648 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635733 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.635968 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636067 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636272 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636389 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636573 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636658 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636873 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.636956 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637180 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637279 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637480 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637600 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637783 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.637864 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638079 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638237 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638390 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638474 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638690 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638775 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.638997 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639092 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639292 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639377 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639593 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639683 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.639946 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640046 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640249 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640332 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640545 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640628 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640847 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.640939 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641153 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641235 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641450 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641538 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641749 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.641833 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642048 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642130 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642342 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642426 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642636 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642720 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.642938 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643022 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643244 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643326 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643542 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643626 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643838 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.643939 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644166 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644261 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644471 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644555 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644768 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.644850 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645063 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645153 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645358 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645441 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645658 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645740 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.645972 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646062 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646275 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646365 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646586 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646671 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.646901 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647002 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647205 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647382 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647490 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647581 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647801 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.647896 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648123 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648212 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648419 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648502 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648714 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.648799 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649008 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649090 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649310 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649393 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649614 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649711 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649912 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.649995 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650225 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650308 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650531 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650614 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650826 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.650914 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651130 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651219 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651431 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651731 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.651820 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652069 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652166 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652375 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652469 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652671 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652754 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.652973 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653062 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653272 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653353 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653573 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653665 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653872 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.653968 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654181 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654264 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654478 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654564 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654776 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.654867 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655073 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655156 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655365 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655449 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655664 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655755 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.655998 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656084 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656326 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656563 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656661 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656886 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.656971 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657192 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657276 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657501 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657593 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657806 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.657896 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658112 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658196 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658428 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658519 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658732 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.658815 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659037 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659121 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659338 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659429 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659636 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659720 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.659947 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660033 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660249 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660331 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660550 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660821 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.660913 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661128 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661210 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661423 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661507 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661723 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.661806 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662018 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662107 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662381 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662549 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662680 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662890 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.662990 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663223 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663321 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663550 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663639 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663853 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.663963 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664184 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664267 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664489 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664576 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664785 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.664868 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665079 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665178 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665375 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665471 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665673 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665755 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.665973 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666069 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666281 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666371 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666583 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666712 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666884 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.666981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667186 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667269 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667487 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667570 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667783 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.667955 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668111 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668202 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668403 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668485 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668697 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668790 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.668991 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669081 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669289 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669373 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669586 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669671 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669877 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.669960 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670177 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670267 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670473 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670556 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670773 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.670856 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671071 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671163 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671364 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671449 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671666 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671749 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.671980 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672067 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672285 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672372 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672582 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672665 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672874 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.672967 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673164 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673247 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673463 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673546 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673760 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.673859 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674050 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674137 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674349 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674448 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674639 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674731 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.674944 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675061 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675236 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675328 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675526 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675617 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675816 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.675898 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676137 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676221 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676436 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676521 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676728 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.676810 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677034 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677116 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677332 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677415 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677623 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677705 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.677940 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678059 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678237 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678347 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678529 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678615 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678819 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.678926 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679117 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679226 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679426 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679540 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679729 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.679842 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680141 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680262 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680364 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680465 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680617 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680750 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.680910 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681057 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681203 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681360 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681500 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681685 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681792 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.681994 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682076 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682296 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682379 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682598 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682683 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.682904 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683010 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683207 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683304 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683500 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683582 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683795 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.683894 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684113 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684208 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684408 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684491 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684724 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.684805 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685017 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685112 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685321 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685411 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685705 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.685926 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686019 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686232 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686316 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686529 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686610 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686825 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.686916 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687124 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687206 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687415 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687532 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687711 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.687795 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688050 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688150 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688357 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688443 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688648 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688732 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.688942 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689025 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689240 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689322 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689539 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689843 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.689935 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690150 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690243 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690458 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690540 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690767 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.690849 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691061 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691159 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691358 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691443 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691657 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691739 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.691976 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692086 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692276 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692359 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692577 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692660 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692878 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.692969 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693180 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693272 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693521 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693614 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693826 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.693926 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694135 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694216 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694418 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694509 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694718 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.694803 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695017 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695099 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695310 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695409 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695624 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695709 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.695931 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696033 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696241 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696325 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696536 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696627 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696823 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.696920 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697122 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697221 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697414 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697499 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697722 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.697812 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698038 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698135 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698350 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698432 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698748 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.698965 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699262 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699344 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699567 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699649 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699870 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.699984 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700185 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700501 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700583 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700809 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.700901 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701115 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701197 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701423 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701507 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701725 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.701809 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702017 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702113 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702314 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702627 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702713 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.702921 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703024 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703214 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703332 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703510 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703634 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703820 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.703960 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704140 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704278 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704451 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704566 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704854 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.704937 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705156 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705250 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705452 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705567 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.705992 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706152 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706249 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706452 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706542 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706753 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.706836 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707055 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707151 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707363 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707448 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707656 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707784 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.707991 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708089 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708290 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708372 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708588 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708670 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708905 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.708988 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.709272 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.709358 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.709581 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.709758 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.709881 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.710192 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.710361 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.710502 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.710806 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.710931 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.711117 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.711472 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.711579 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.711814 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.711898 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712143 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712239 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712456 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712549 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712769 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.712854 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.713064 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.713159 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.713722 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.713816 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714024 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714107 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714319 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714410 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714615 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714701 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.714924 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715007 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715217 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715332 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715519 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715646 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715821 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.715980 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716144 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716287 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716437 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716608 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716734 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.716929 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717047 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717247 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717348 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717569 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717653 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.717933 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718015 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718245 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718338 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718555 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718639 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718851 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.718934 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719161 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719246 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719460 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719544 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719756 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.719840 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720089 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720193 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720372 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720460 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720680 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720763 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.720984 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721068 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721294 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721384 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721603 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721701 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721912 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.721996 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722211 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722309 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722508 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722602 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722812 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.722904 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723130 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723213 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723430 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723529 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723745 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.723828 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724063 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724152 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724362 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724509 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724663 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.724790 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725045 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725492 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725622 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725709 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725709 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725871 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.725952 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726037 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726250 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726350 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726550 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726645 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726890 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.726984 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727211 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727328 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727486 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727579 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727796 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.727896 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728121 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728219 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728414 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728506 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728711 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.728806 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729003 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729090 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729334 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729419 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729628 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729733 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.729950 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730036 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730248 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730332 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730559 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730865 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.730951 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731167 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731250 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731467 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731561 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731767 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.731851 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732094 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732194 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732395 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732491 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732694 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732778 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.732993 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733086 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733297 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733385 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733596 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733680 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733899 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.733985 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.734214 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.734404 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.734547 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.734723 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.734854 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735028 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735166 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735332 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735459 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735636 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735764 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.735960 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736052 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736268 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736361 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736567 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736651 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736867 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.736953 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737165 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737250 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737466 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737570 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737779 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.737872 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738094 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738174 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738407 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738512 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738728 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.738813 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739033 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739127 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739338 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739434 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739644 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739729 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.739969 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.740068 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.740467 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.740583 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.740791 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.740866 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741150 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741251 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741467 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741554 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741773 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.741857 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742081 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742166 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742385 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742517 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742689 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742782 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.742992 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743075 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743295 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743389 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743598 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743703 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743885 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.743999 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744213 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744298 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744523 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744637 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744840 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.744947 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745166 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745270 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745475 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745577 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745782 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.745878 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746087 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746181 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746394 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746491 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746732 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.746900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747037 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747206 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747351 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747530 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747665 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.747842 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748000 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748182 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748313 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748491 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748621 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748800 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.748933 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749116 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749245 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749412 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749553 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749706 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.749861 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750008 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750172 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750311 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750483 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750605 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750806 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.750900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751138 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751232 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751456 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751540 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751768 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.751858 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.752090 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.752177 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.752405 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.752607 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.752918 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753008 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753231 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753316 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753542 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753631 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753856 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.753940 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754164 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754249 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754463 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754558 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754774 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.754872 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755070 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755155 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755366 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755448 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755670 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.755765 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756066 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756158 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756418 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756550 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756791 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.756887 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757043 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757161 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757356 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757457 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757659 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757757 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.757982 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758077 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758291 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758406 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758610 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758817 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.758905 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759257 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759472 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759568 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759776 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.759862 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760104 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760190 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760398 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760495 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760696 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760781 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.760991 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761075 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761293 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761387 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761589 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761674 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761887 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.761978 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762181 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762481 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762567 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762773 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.762860 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763073 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763160 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763367 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763453 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763666 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763756 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.763982 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764071 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764289 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764617 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764725 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.764920 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765013 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765218 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765302 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765523 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765618 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765826 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.765910 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766126 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766208 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766430 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766525 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766737 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.766966 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767070 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767289 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767375 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767604 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767700 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.767922 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768012 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768235 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768320 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768543 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768714 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768838 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.768925 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769135 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769239 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769433 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769517 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769741 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.769837 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770042 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770135 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770342 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770428 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770646 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770744 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.770945 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.771040 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.771245 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.771331 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.771546 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.771632 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772143 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772338 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772426 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772505 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772583 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772662 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.772851 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773071 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773156 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773371 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773456 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773671 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773765 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.773977 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774064 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774304 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774615 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774709 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.774924 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775016 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775231 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775316 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775537 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775624 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775836 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.775942 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776164 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776259 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776465 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776551 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776764 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.776857 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777071 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777167 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777380 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777467 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777680 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777763 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.777977 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778085 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778282 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778366 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778591 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778676 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.778901 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779036 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779211 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779298 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779520 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779612 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779827 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.779946 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780172 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780258 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780481 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780565 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780795 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.780882 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781099 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781185 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781412 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781495 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781728 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.781814 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782038 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782124 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782348 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782641 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782727 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.782938 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783034 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783232 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783316 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783532 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783619 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783839 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.783964 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784185 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784279 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784521 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784606 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784816 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.784901 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785117 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785214 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785412 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785499 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785707 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.785792 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786000 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786097 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786294 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786386 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786594 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786680 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.786886 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.787003 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.787181 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.787411 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.787841 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.787971 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788054 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788123 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788201 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788368 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788464 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788684 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788778 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.788984 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789078 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789280 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789366 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789572 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789670 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789867 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.789952 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790164 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790249 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790479 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790564 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790785 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.790871 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791089 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791176 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791485 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791697 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.791781 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792022 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792114 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792325 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792412 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792626 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792711 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.792952 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793080 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793234 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793329 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793531 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793622 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793836 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.793931 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794138 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794232 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794437 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794523 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794733 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.794829 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795031 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795124 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795333 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795425 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795623 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795717 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.795935 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796034 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796245 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796332 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796545 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796632 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796855 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.796938 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797165 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797265 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797480 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797619 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797786 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.797880 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798088 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798175 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798403 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798489 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798701 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.798784 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799002 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799086 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799303 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799390 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799606 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799693 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.799908 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800099 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800244 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800331 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800545 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800630 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800845 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.800939 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801152 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801236 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801455 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801544 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801760 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.801853 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802069 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802155 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802367 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802450 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802682 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.802768 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803072 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803561 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803654 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803735 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803735 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.803903 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804013 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804104 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804303 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804607 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804694 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.804909 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.805003 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.805204 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.805299 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.805439 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:19:08.805607 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.805920 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.806230 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.806540 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.806857 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.807165 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.807532 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.807789 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.808136 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.808461 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.808785 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.809095 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.809418 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.809742 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.810086 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.810399 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.810742 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.811067 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.811380 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.811691 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.812014 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:19:08.812258 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:19:08.962054 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Registered counter for database nova_api Aug 23 04:19:08.968147 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO dbcounter [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Registered counter for database nova_api Aug 23 04:19:08.987909 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:08.989493 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_db.sqlalchemy.engines [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:08.995162 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:08.996374 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writer thread running {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.050083 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.context [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),101fad6b-7e6e-45d6-8875-d41a29e76ec7(cell1) {{(pid=105916) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 04:19:09.051357 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.context [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),101fad6b-7e6e-45d6-8875-d41a29e76ec7(cell1) {{(pid=105915) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 04:19:09.054090 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:19:09.054568 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:19:09.055268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:19:09.055746 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:19:09.056159 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:19:09.056887 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:19:09.057318 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:19:09.057544 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:19:09.058085 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:19:09.058538 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:19:09.059311 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:19:09.060553 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:19:09.061283 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Registered counter for database nova_cell0 Aug 23 04:19:09.062516 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO dbcounter [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Registered counter for database nova_cell0 Aug 23 04:19:09.066790 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Registered counter for database nova_cell1 Aug 23 04:19:09.067942 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO dbcounter [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Registered counter for database nova_cell1 Aug 23 04:19:09.074662 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.077001 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_db.sqlalchemy.engines [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.078454 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_db.sqlalchemy.engines [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.079586 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.080440 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.086172 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writer thread running {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.086512 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writer thread running {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.217568 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.227219 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Registered counter for database nova_cell0 Aug 23 04:19:09.227375 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO dbcounter [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Registered counter for database nova_cell0 Aug 23 04:19:09.238940 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_db.sqlalchemy.engines [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.242542 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:19:09.243466 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writer thread running {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.247502 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:19:09.581224 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: WARNING keystonemiddleware.auth_token [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:19:09.588091 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:19:09.588816 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: WARNING keystonemiddleware.auth_token [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:19:09.595677 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:19:09.936398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: WARNING keystonemiddleware.auth_token [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:19:09.942659 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: WARNING keystonemiddleware.auth_token [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:19:09.943098 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:19:09.947947 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574643269c0 pid: 105915 (default app) Aug 23 04:19:09.949131 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-a4dd0183-b9bf-4f78-a469-011c4a793aae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:19:09.950012 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:19:09.951182 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 23 04:19:09.951584 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Aug 23 04:19:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:19:09.954519 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574643269c0 pid: 105916 (default app) Aug 23 04:20:28.571320 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:28.572602 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Aug 23 04:20:28.573093 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:28.585474 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:28.586602 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell1:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:28.587473 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell0:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:28.588862 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:29.510421 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-d6bf3c50-a441-4629-a15a-7c720e6e023c admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:29.543292 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-d6bf3c50-a441-4629-a15a-7c720e6e023c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.963023 Aug 23 04:20:29.544071 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Aug 23 04:20:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:31.908497 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:31.909489 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-1e4b26a4-c1c6-4d6b-8d9a-367e17cb0659 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 23 04:20:31.910050 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:32.361678 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-e47373b2-28a3-4dd6-a5d6-76bf3a4099eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "disk": 1}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:32.384159 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:32.384159 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: warnings.warn(msg) Aug 23 04:20:32.415070 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-e47373b2-28a3-4dd6-a5d6-76bf3a4099eb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498910 Aug 23 04:20:32.415782 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:20:32.636004 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-bde677f3-1341-4604-90d8-c3c2a08c36c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:32.640398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:32.640398 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:20:32.643108 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_api:SELECT=3 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:32.644004 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_cell0:SELECT=3 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:32.644861 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_cell1:SELECT=3 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:32.645555 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:32.704043 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-bde677f3-1341-4604-90d8-c3c2a08c36c7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279601 Aug 23 04:20:32.704551 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Aug 23 04:20:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:35.067501 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-e47373b2-28a3-4dd6-a5d6-76bf3a4099eb admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:35.068455 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-e47373b2-28a3-4dd6-a5d6-76bf3a4099eb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Aug 23 04:20:35.069022 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:35.767062 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-549b8c8b-d008-4148-b44b-e843667881fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:35.787013 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:35.787013 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:20:35.808403 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-549b8c8b-d008-4148-b44b-e843667881fb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.732716 Aug 23 04:20:35.809330 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:20:35.820875 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-fc527317-b9b5-4142-af7a-47b9610c769b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:35.824554 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:35.824554 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: warnings.warn(msg) Aug 23 04:20:35.861077 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-fc527317-b9b5-4142-af7a-47b9610c769b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043841 Aug 23 04:20:35.861675 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Aug 23 04:20:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:20:38.249495 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-549b8c8b-d008-4148-b44b-e843667881fb admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:38.250502 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-549b8c8b-d008-4148-b44b-e843667881fb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 23 04:20:38.250900 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:38.666711 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-c75de9a3-7420-45dc-a1d0-3c91f2c16588 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:38.686881 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-c75de9a3-7420-45dc-a1d0-3c91f2c16588 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429469 Aug 23 04:20:38.687414 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:20:38.699741 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-f239a644-9712-4cbb-a9d6-4ffceb10a9cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:38.723500 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-f239a644-9712-4cbb-a9d6-4ffceb10a9cc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027697 Aug 23 04:20:38.724104 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Aug 23 04:20:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:41.075354 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-c75de9a3-7420-45dc-a1d0-3c91f2c16588 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:41.076409 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-c75de9a3-7420-45dc-a1d0-3c91f2c16588 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 23 04:20:41.076810 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:41.547403 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-1c910dc3-f51e-4b43-bb80-a03cce36f526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:41.568919 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-1c910dc3-f51e-4b43-bb80-a03cce36f526 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486014 Aug 23 04:20:41.569681 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:20:41.584091 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ffcbd6af-9655-4707-b844-93213e30925d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:41.615508 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-ffcbd6af-9655-4707-b844-93213e30925d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035117 Aug 23 04:20:41.631943 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Aug 23 04:20:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:43.940220 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-1c910dc3-f51e-4b43-bb80-a03cce36f526 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:43.941162 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-1c910dc3-f51e-4b43-bb80-a03cce36f526 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 23 04:20:43.941593 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:44.393429 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:44.415036 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465554 Aug 23 04:20:44.416192 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:20:44.428299 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-8a672bcb-9963-4459-aa16-5a09dda23fb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:44.454828 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-8a672bcb-9963-4459-aa16-5a09dda23fb4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030076 Aug 23 04:20:44.464792 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Aug 23 04:20:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:46.823953 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:46.825082 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Aug 23 04:20:46.825502 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:20:47.260920 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-222c9a00-ba6b-4a66-b782-2b929d8e1db4 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:47.285987 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-222c9a00-ba6b-4a66-b782-2b929d8e1db4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454125 Aug 23 04:20:47.286519 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Aug 23 04:20:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:20:49.734296 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:49.735442 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-85e192ce-a04d-47bd-b2b9-b271bc1026f9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 23 04:20:49.735846 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:50.175481 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-30a74b9d-b7b4-492d-bc32-9be2304e6833 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:50.198361 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-30a74b9d-b7b4-492d-bc32-9be2304e6833 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455968 Aug 23 04:20:50.199028 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:20:50.212415 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-67db0420-4ee8-405a-bf18-5f81e8f6b9e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:50.239951 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-67db0420-4ee8-405a-bf18-5f81e8f6b9e6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031597 Aug 23 04:20:50.243955 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Aug 23 04:20:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:52.681314 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-30a74b9d-b7b4-492d-bc32-9be2304e6833 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:52.682369 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-30a74b9d-b7b4-492d-bc32-9be2304e6833 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 23 04:20:52.683200 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:53.086202 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a005fd0f-c3a4-4cc6-9398-188378082325 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "name": "m1.small"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:53.106337 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a005fd0f-c3a4-4cc6-9398-188378082325 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417222 Aug 23 04:20:53.106886 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:20:53.119447 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-bd05a81e-c6b9-430a-a1d2-5d74debfefe0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:53.143848 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-bd05a81e-c6b9-430a-a1d2-5d74debfefe0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028722 Aug 23 04:20:53.144664 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Aug 23 04:20:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:20:55.485738 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a005fd0f-c3a4-4cc6-9398-188378082325 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:55.486874 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a005fd0f-c3a4-4cc6-9398-188378082325 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Aug 23 04:20:55.487345 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:55.899069 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-926d87db-42d3-4768-b0e3-0c2904299540 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:55.918597 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-926d87db-42d3-4768-b0e3-0c2904299540 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.424767 Aug 23 04:20:55.919152 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:20:55.931580 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-dbb55015-0c1b-4482-ac6d-21289e278a09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:55.958869 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-dbb55015-0c1b-4482-ac6d-21289e278a09 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030948 Aug 23 04:20:55.959489 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Aug 23 04:20:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:20:58.304239 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-926d87db-42d3-4768-b0e3-0c2904299540 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:20:58.305227 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-926d87db-42d3-4768-b0e3-0c2904299540 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 23 04:20:58.305894 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:20:58.873610 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a31dea65-3a28-4b38-8d55-63d1718ff17c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:58.880978 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:58.901217 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a31dea65-3a28-4b38-8d55-63d1718ff17c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.588612 Aug 23 04:20:58.902320 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:20:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:20:58.914166 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-08005e69-2f57-41f6-940b-93b8670c0ca0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:20:58.940882 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-08005e69-2f57-41f6-940b-93b8670c0ca0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030332 Aug 23 04:20:58.956030 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Aug 23 04:20:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:21:01.306200 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a31dea65-3a28-4b38-8d55-63d1718ff17c admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:01.308287 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a31dea65-3a28-4b38-8d55-63d1718ff17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002485 Aug 23 04:21:01.312402 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:21:01 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:01.748042 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:01.768486 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453387 Aug 23 04:21:01.769314 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Aug 23 04:21:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:21:01.781652 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-07af9eaf-d041-4754-8e16-a9bb51c5ee8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:01.809568 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-07af9eaf-d041-4754-8e16-a9bb51c5ee8f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031798 Aug 23 04:21:01.810612 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Aug 23 04:21:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:21:20.454158 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:20.455204 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 23 04:21:20.455638 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:20.469853 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:21:20.986042 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-fc6bb913-4e5b-4f22-83db-494d02771241 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:21.004933 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-fc6bb913-4e5b-4f22-83db-494d02771241 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.542683 Aug 23 04:21:21.005390 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Aug 23 04:21:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:22.127326 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:22.128349 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-96c57eae-64e2-485d-8e0a-cd34c7ef776e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 23 04:21:22.128737 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:22.717042 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-581aa3cb-a55e-4072-a50c-7d09fea441e2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:22.722790 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-581aa3cb-a55e-4072-a50c-7d09fea441e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-581aa3cb-a55e-4072-a50c-7d09fea441e2 admin admin] Request method failure captured: Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Host: 10.222.0.18 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBFXCgRxU668NojVPkn8idDl2gUMPHpeLUNItg6MaMO3xB1mr1Slns5An7z2eZw92Ws_NRLaQYt3V74-5nBdqXcEfHgn0l7aAJio0nD5DxQvq53Fc0UNfmV9WVrAsmOsQM9MlQyTeJZBf3Cwvxiyl92ZlRcVdDhapchGSsl0wS5_X-Os Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 23 04:21:22.726056 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User: admin Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: method: > Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: exception: Flavor 42 could not be found. Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: action_args: {'id': '42'} Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:22.727609 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:22.728859 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.729981 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-581aa3cb-a55e-4072-a50c-7d09fea441e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:22.730970 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-581aa3cb-a55e-4072-a50c-7d09fea441e2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.455938 Aug 23 04:21:22.730970 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Aug 23 04:21:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 04:21:22.738302 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-317685e8-c73d-4295-acb2-50306867188e admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:22.742380 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:21:22.762371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-317685e8-c73d-4295-acb2-50306867188e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027798 Aug 23 04:21:22.762913 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:22.778002 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-85f148da-2fce-43b7-a723-5836cb67c320 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:22.806078 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-85f148da-2fce-43b7-a723-5836cb67c320 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033854 Aug 23 04:21:22.806670 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:22.817090 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-be8b49d7-cc89-4c18-afb2-118abe3b30d9 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:22.824572 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.wsgi [None req-be8b49d7-cc89-4c18-afb2-118abe3b30d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-be8b49d7-cc89-4c18-afb2-118abe3b30d9 admin admin] Request method failure captured: Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept: application/json Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept-Encoding: gzip, deflate Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Connection: keep-alive Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Content-Length: 0 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Host: 10.222.0.18 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-System-Scope: None Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: User-Agent: python-novaclient Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Auth-Token: gAAAAABjBFXCgRxU668NojVPkn8idDl2gUMPHpeLUNItg6MaMO3xB1mr1Slns5An7z2eZw92Ws_NRLaQYt3V74-5nBdqXcEfHgn0l7aAJio0nD5DxQvq53Fc0UNfmV9WVrAsmOsQM9MlQyTeJZBf3Cwvxiyl92ZlRcVdDhapchGSsl0wS5_X-Os Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Id: None Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Name: None Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Identity-Status: Confirmed Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Is-Admin-Project: True Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Id: default Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Name: Default Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Name: admin Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Role: admin,member,reader Aug 23 04:21:22.827893 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Roles: admin,member,reader Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant: admin Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Name: admin Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User: admin Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Id: default Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Name: Default Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Name: admin Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: method: > Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: exception: Flavor 42 could not be found. Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: action_args: {'id': '42'} Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:22.829371 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:22.830413 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:22.832110 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-be8b49d7-cc89-4c18-afb2-118abe3b30d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:22.833316 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-be8b49d7-cc89-4c18-afb2-118abe3b30d9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016611 Aug 23 04:21:22.833316 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Aug 23 04:21:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 04:21:23.825539 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-85f148da-2fce-43b7-a723-5836cb67c320 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:23.826544 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-85f148da-2fce-43b7-a723-5836cb67c320 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 23 04:21:23.826933 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:24.393858 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-a2af573f-8868-4658-81f4-090dcd1e6185 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:24.399268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.wsgi [None req-a2af573f-8868-4658-81f4-090dcd1e6185 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-a2af573f-8868-4658-81f4-090dcd1e6185 admin admin] Request method failure captured: Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept: application/json Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept-Encoding: gzip, deflate Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Connection: keep-alive Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Content-Length: 0 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Host: 10.222.0.18 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-System-Scope: None Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: User-Agent: python-novaclient Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Auth-Token: gAAAAABjBFXDGWKtxNJdee8VdNfTgaQf2Cv8qIK7dIsqOsbcOPcXkV_Iey0057DAxFoZicqrHOgCMnCHbUOQGOKRMRl5RV5SIa36xn9-idf59GMZiu9y7c3yUiGRi-A1KqD7wPXw2Z6Fs0Y94-PWxVLjC526l3hbS8t4xpGxaFDQopRiIb2npU4 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Id: None Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Name: None Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Identity-Status: Confirmed Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Is-Admin-Project: True Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Id: default Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Name: Default Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Name: admin Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Role: admin,member,reader Aug 23 04:21:24.402455 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Roles: admin,member,reader Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant: admin Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Name: admin Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User: admin Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Id: default Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Name: Default Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Name: admin Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: method: > Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: exception: Flavor 84 could not be found. Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: action_args: {'id': '84'} Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:24.403798 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:24.404623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.405707 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-a2af573f-8868-4658-81f4-090dcd1e6185 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:24.406820 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-a2af573f-8868-4658-81f4-090dcd1e6185 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440611 Aug 23 04:21:24.406820 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Aug 23 04:21:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 04:21:24.416432 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-8b7a89f8-2b9d-4fcc-8938-0e782f4e4a49 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:24.431824 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-8b7a89f8-2b9d-4fcc-8938-0e782f4e4a49 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019377 Aug 23 04:21:24.432467 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:24.444837 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-d11182bb-9aa5-4f79-a580-71475dd8ba29 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:24.462579 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-d11182bb-9aa5-4f79-a580-71475dd8ba29 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023577 Aug 23 04:21:24.463126 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:24.473415 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-62850a8f-7e95-4689-b51d-95900ea9fdc5 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:24.478899 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-62850a8f-7e95-4689-b51d-95900ea9fdc5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-62850a8f-7e95-4689-b51d-95900ea9fdc5 admin admin] Request method failure captured: Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Host: 10.222.0.18 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBFXDGWKtxNJdee8VdNfTgaQf2Cv8qIK7dIsqOsbcOPcXkV_Iey0057DAxFoZicqrHOgCMnCHbUOQGOKRMRl5RV5SIa36xn9-idf59GMZiu9y7c3yUiGRi-A1KqD7wPXw2Z6Fs0Y94-PWxVLjC526l3hbS8t4xpGxaFDQopRiIb2npU4 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 23 04:21:24.480433 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User: admin Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: method: > Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: exception: Flavor 84 could not be found. Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: action_args: {'id': '84'} Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:24.481852 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:24.482900 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:24.484376 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-62850a8f-7e95-4689-b51d-95900ea9fdc5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:24.485599 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-62850a8f-7e95-4689-b51d-95900ea9fdc5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011955 Aug 23 04:21:24.485599 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Aug 23 04:21:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 04:21:25.501876 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-d11182bb-9aa5-4f79-a580-71475dd8ba29 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:25.503070 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-d11182bb-9aa5-4f79-a580-71475dd8ba29 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 Aug 23 04:21:25.503621 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:26.066928 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-970aa35f-4a01-4390-8519-58698bce707d admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:26.073043 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-970aa35f-4a01-4390-8519-58698bce707d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-970aa35f-4a01-4390-8519-58698bce707d admin admin] Request method failure captured: Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Host: 10.222.0.18 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBFXFTlplA3klf3uH2W-Dn10FCzHUHP1I9oAy81QAENq5RTnu6HNn0mtR0iC7jMHYbevEGoIU93zikcEa0_F3KN0xCkkMLSz8bjGdT8cu96DuPe2lnL4kyDQbhmq4-iyFlLs4Ybx_nULHoIbDj-lx1UOh4a6KtVm6tyweOvLu-GfXQgk Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 23 04:21:26.074552 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User: admin Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: method: > Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: exception: Flavor 451 could not be found. Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: action_args: {'id': '451'} Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:26.076105 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:26.080754 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.082014 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-970aa35f-4a01-4390-8519-58698bce707d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:26.083279 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-970aa35f-4a01-4390-8519-58698bce707d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437695 Aug 23 04:21:26.083279 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:21:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 04:21:26.085935 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-158f2ad0-ee91-4273-838a-0fc39f3c4363 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:26.101551 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-158f2ad0-ee91-4273-838a-0fc39f3c4363 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019260 Aug 23 04:21:26.102077 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:26.111761 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:26.127425 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019208 Aug 23 04:21:26.127968 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Aug 23 04:21:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:21:26.137709 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-69569aab-bde6-4c19-b66f-e13c8d079b28 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:26.143114 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.wsgi [None req-69569aab-bde6-4c19-b66f-e13c8d079b28 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-69569aab-bde6-4c19-b66f-e13c8d079b28 admin admin] Request method failure captured: Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept: application/json Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Accept-Encoding: gzip, deflate Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Connection: keep-alive Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Content-Length: 0 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Host: 10.222.0.18 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-Api-Version: compute 2.90 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Openstack-System-Scope: None Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: User-Agent: python-novaclient Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Auth-Token: gAAAAABjBFXFTlplA3klf3uH2W-Dn10FCzHUHP1I9oAy81QAENq5RTnu6HNn0mtR0iC7jMHYbevEGoIU93zikcEa0_F3KN0xCkkMLSz8bjGdT8cu96DuPe2lnL4kyDQbhmq4-iyFlLs4Ybx_nULHoIbDj-lx1UOh4a6KtVm6tyweOvLu-GfXQgk Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Id: None Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Domain-Name: None Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Identity-Status: Confirmed Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Is-Admin-Project: True Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Id: default Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Domain-Name: Default Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Project-Name: admin Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Role: admin,member,reader Aug 23 04:21:26.144657 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Roles: admin,member,reader Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba69f2ba4f0d496e9c7607a800699841", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba69f2ba4f0d496e9c7607a800699841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant: admin Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Id: ba69f2ba4f0d496e9c7607a800699841 Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-Tenant-Name: admin Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User: admin Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Id: default Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Domain-Name: Default Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Id: de65eb39f13f4a92a6a526fb5ab1f5c5 Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: X-User-Name: admin Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: method: > Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: exception: Flavor 451 could not be found. Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: action_args: {'id': '451'} Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:21:26.146164 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:26.147128 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: ERROR nova.api.openstack.wsgi Aug 23 04:21:26.148522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-69569aab-bde6-4c19-b66f-e13c8d079b28 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:21:26.149731 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-69569aab-bde6-4c19-b66f-e13c8d079b28 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012295 Aug 23 04:21:26.149731 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:21:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 04:21:27.128926 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:27.130479 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Aug 23 04:21:27.131100 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:27.695807 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-66524680-e960-404b-9d4a-6d2187085b0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:27.723415 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-66524680-e960-404b-9d4a-6d2187085b0e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.454645 Aug 23 04:21:27.723958 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Aug 23 04:21:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:21:28.706687 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:28.707790 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 23 04:21:28.708191 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:29.288116 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-cd3d3033-02b0-4796-8555-cbaf555e1380 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:29.311132 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-cd3d3033-02b0-4796-8555-cbaf555e1380 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.461677 Aug 23 04:21:29.311720 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Aug 23 04:21:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:21:30.336311 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:30.337318 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 23 04:21:30.337711 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:30.902614 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-e2db949f-03cf-4248-bc60-44d47f2d4144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:30.923119 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-e2db949f-03cf-4248-bc60-44d47f2d4144 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.449188 Aug 23 04:21:30.923675 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Aug 23 04:21:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:21:31.919908 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:31.921016 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 23 04:21:31.921410 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:32.502620 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-dd84b937-f4e6-40bf-85cf-f7b42816e954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:21:32.524268 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-dd84b937-f4e6-40bf-85cf-f7b42816e954 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.465126 Aug 23 04:21:32.524821 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Aug 23 04:21:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:21:33.521616 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:33.522631 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 23 04:21:33.523006 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:21:34.087085 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-87747d84-ee3f-4f48-ba93-a541505e4488 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:21:34.109092 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-87747d84-ee3f-4f48-ba93-a541505e4488 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.448250 Aug 23 04:21:34.109607 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Aug 23 04:21:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:22:28.637336 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:28.638993 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-40bfd749-4717-431a-b22f-b963ed103079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002428 Aug 23 04:22:28.639654 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Aug 23 04:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:22:28.657773 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:29.070690 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-fda6d21c-f400-46e6-80de-8bd951efb00a admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:29.090984 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-fda6d21c-f400-46e6-80de-8bd951efb00a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441201 Aug 23 04:22:29.091438 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Aug 23 04:22:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:22:29.118989 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:SELECT=14 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:29.122994 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-0653b041-e861-467b-913b-3672d80f661d admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:29.131102 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-0653b041-e861-467b-913b-3672d80f661d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014629 Aug 23 04:22:29.131633 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Aug 23 04:22:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:22:29.146354 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-d281fc30-c769-42ee-8b52-bf9703f1562e admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:29.155411 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-d281fc30-c769-42ee-8b52-bf9703f1562e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015099 Aug 23 04:22:29.155957 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Aug 23 04:22:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:22:29.167739 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:29.175584 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011600 Aug 23 04:22:29.176146 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Aug 23 04:22:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:22:29.187763 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-a9c1cf82-165e-4f75-aa6a-651b5dcf5bfb admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:22:29.195620 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-a9c1cf82-165e-4f75-aa6a-651b5dcf5bfb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011469 Aug 23 04:22:29.196185 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Aug 23 04:22:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:25:20.016805 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:20.017860 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 23 04:25:20.018260 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:25:20.159373 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_api:SELECT=6 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:20.328449 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:20.330881 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:25:20.330881 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:25:20.332029 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:20.332510 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:20.332929 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:20.333631 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:20.334074 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:20.334485 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:20.369348 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-b470a07c-9510-4ba3-98ac-6a558fd943ca admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.211361 Aug 23 04:25:20.369900 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:25:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:25:21.207705 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:21.208753 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 23 04:25:21.209145 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:25:21.415392 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:21.417874 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:25:21.417874 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:25:21.419022 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:21.419522 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:21.419962 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:21.420750 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:21.421201 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:21.421606 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:21.441264 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-7064aab5-a757-473a-90c0-cb362f8d9474 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090622 Aug 23 04:25:21.441818 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:25:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:25:32.712938 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:32.713865 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 23 04:25:32.714254 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:25:32.855108 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_cell0:SELECT=4 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:32.855792 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_cell1:SELECT=4 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:32.856438 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG dbcounter [-] [105915] Writing DB stats nova_api:SELECT=8 {{(pid=105915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:32.915236 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:32.917623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:25:32.917623 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:25:32.918795 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:32.919188 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:32.919645 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:32.920339 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:32.920776 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:32.921189 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:32.946076 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-50fa0258-0c0a-4094-8e2c-f7558a6966a2 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095371 Aug 23 04:25:32.946633 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:25:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:25:33.777229 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:33.778301 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bd279084-1ecc-491c-b27f-9bbdbedee504 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 23 04:25:33.778695 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Aug 23 04:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:25:33.993444 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG nova.api.openstack.wsgi [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Calling method '>' {{(pid=105915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:25:33.995851 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:25:33.995851 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: warnings.warn(msg) Aug 23 04:25:33.996976 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:33.997443 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:33.997863 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:33.998566 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:25:33.999002 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:25:33.999406 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: DEBUG oslo_concurrency.lockutils [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:25:34.021782 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: INFO nova.api.openstack.requestlog [None req-7e9e31ba-f5f0-47c1-92af-a03615c4cd0c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.103806 Aug 23 04:25:34.022328 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: [pid: 105915|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Aug 23 04:25:33 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:26:30.139957 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: Tue Aug 23 04:26:30 2022 - graceful shutdown triggered... Aug 23 04:26:30.139661 dv-cinder-854070-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 04:26:30.141673 dv-cinder-854070-1-iscsi devstack@n-api.service[105915]: Gracefully killing worker 1 (pid: 105915)... Aug 23 04:26:30.142285 dv-cinder-854070-1-iscsi devstack@n-api.service[105916]: Gracefully killing worker 2 (pid: 105916)... Aug 23 04:26:31.140294 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: worker 1 buried after 1 seconds Aug 23 04:26:31.140294 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: worker 2 buried after 1 seconds Aug 23 04:26:31.140294 dv-cinder-854070-1-iscsi devstack@n-api.service[105914]: goodbye to uWSGI. Aug 23 04:26:31.142332 dv-cinder-854070-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 04:26:31.142953 dv-cinder-854070-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 04:26:31.146017 dv-cinder-854070-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 04:26:31.159373 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 04:26:31 2022] *** Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: nodename: dv-cinder-854070-1-iscsi Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: machine: x86_64 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: clock source: unix Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: pcre jit disabled Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: detected number of CPU cores: 4 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: current working directory: / Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: detected binary path: /usr/bin/uwsgi-core Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: your processes number limit is 47680 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: your memory page size is 4096 bytes Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: detected max file descriptor number: 2048 Aug 23 04:26:31.161341 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: lock engine: pthread robust mutexes Aug 23 04:26:31.162229 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: thunder lock: enabled Aug 23 04:26:31.162229 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 04:26:31.162229 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 04:26:31.200866 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: Python main interpreter initialized at 0x560340f879c0 Aug 23 04:26:31.200866 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: python threads support enabled Aug 23 04:26:31.200866 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: your server socket listen backlog is limited to 100 connections Aug 23 04:26:31.200866 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: your mercy for graceful operations on workers is 90 seconds Aug 23 04:26:31.201300 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 04:26:31.201300 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: *** Operational MODE: preforking *** Aug 23 04:26:31.201561 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: *** uWSGI is running in multiple interpreter mode *** Aug 23 04:26:31.201561 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: spawned uWSGI master process (pid: 121211) Aug 23 04:26:31.201773 dv-cinder-854070-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 04:26:31.204346 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: spawned uWSGI worker 1 (pid: 121223, cores: 1) Aug 23 04:26:31.204346 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: spawned uWSGI worker 2 (pid: 121224, cores: 1) Aug 23 04:26:31.204346 dv-cinder-854070-1-iscsi devstack@n-api.service[121211]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 04:26:31.879455 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 04:26:31.883963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 04:26:33.027654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:26:33.027654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: from cryptography.utils import int_from_bytes Aug 23 04:26:33.028422 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:26:33.028422 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: from cryptography.utils import int_from_bytes Aug 23 04:26:33.056596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:26:33.056596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: from cryptography.utils import int_from_bytes Aug 23 04:26:33.057169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:26:33.057169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: from cryptography.utils import int_from_bytes Aug 23 04:26:35.456489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:26:35.457088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:26:35.457403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:26:35.457643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:26:35.457906 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:26:35.458291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.461996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-1-iscsi {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.462986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.463428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.463673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.463902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.464432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.465185 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.465778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.466238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.466740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.467201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.467664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.468160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.468629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.469110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.469627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.470461 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-1-iscsi {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.471291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.472548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.472881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.473316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.473592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.473936 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.474253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.474575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.474887 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.475209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.475526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.475842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.476156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.476459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.476761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.477270 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.477595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.477882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.478182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.478447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.478751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.479069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.479383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.479702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.479988 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.480208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.480702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.481017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.481323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.481627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.481930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.482234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.482523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.482828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.483146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.483445 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.483761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.484097 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.484416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.484722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.485051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.485671 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.486102 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.486539 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.487395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.487395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.487678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.487817 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.488391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.488391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.488705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.489091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.489348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.489665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.489963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.490212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.490511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.490915 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.491108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.491410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.491713 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.492051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.492349 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.492763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.492955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.493395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.493557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.493821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.494121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.494421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.494719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.495022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.495340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.495654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.495986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.496290 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.496590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.497203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.497504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.497805 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.498142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.498737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.498737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.499029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.499310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.499612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.499964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.500241 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.500541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.501276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.501276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.501783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.501939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.502115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.502436 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.502699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.503220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.503524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.503820 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.504164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.504482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.504789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.505092 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.505394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.505706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.506044 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.506370 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.506708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.507020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.507347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.507672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.508008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.508323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.508634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.508955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.509260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.509566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.509871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.510185 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.510499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.510821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.511131 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.511442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.511754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.512080 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.512395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.512717 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.513033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.513337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.513675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.514013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.514321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.514639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.514958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.515263 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.515567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.515872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.516212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.516735 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.517048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.517361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.517670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.517979 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.518289 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.518594 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.518899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.519041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:26:35.519471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.519577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:26:35.519665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.519818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.519988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:26:35.520149 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.520292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:26:35.520459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.520560 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:26:35.520765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.520943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.521069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.521271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.521364 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.521596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.521691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.521941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.522034 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.522238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.522399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.522541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.522713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.522838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.523048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.523149 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.523376 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.523472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.523708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.523847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.524028 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.524171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.524345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.525147 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.525147 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.525465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-1-iscsi {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.525625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.525779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.525931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.526082 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.526236 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.526393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.526550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.526709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.526860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.527010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.527155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.527307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.527450 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.527593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.527743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.527743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.528070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.528262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.528409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.529723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.529890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.529987 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.530233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.530490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.530665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530757 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.530849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.530933 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.531022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.531115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.531207 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.531293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.531383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.531474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.531614 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.531751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-1-iscsi {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.531848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.531848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.532246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.532407 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.532554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.532706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.532851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.532946 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.532946 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.533083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.533349 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.533445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.533531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.533618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.533740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.533923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.534032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.534119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.534262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.534355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.534440 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.534631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.534739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.534955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.535052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.535260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.535358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.535557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.535652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.535871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.536026 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.536198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.536298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.536502 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.536597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.536803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.536895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.537101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.537202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.537412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.537505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.537666 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.537766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.537975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.538066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.538298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.538398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.538625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.538724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.538965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.539118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.539210 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.539346 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.539460 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.539567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.539780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.539880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.540129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.540277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.540456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.540548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.540761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.540853 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.541076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.541170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.541382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.541479 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.541697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.541837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.542000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.542093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.542303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.542402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.542606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.542705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.542919 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.543018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.543218 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.543319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.543526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.543635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.543857 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.543969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.544203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.544306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.544514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.544620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.544831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.544932 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.545136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.545230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.545442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.545543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.545748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.545848 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.546051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.546143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.546354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.546455 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.546659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.546774 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.546973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.547105 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.547280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.547413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.547616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.547773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.548021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.548121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.548260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.548473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.548604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.548805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.548909 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.549059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.549264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.549356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.549497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.549655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.549756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.549974 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.550076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.550285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.550384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.550606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.550705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.550936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.551037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.551241 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.551339 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.551545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.551637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.551851 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.552017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.552177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.552271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.552477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.552575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.552781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.552882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.553095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.553194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.553399 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.553499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.553706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.553813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.554006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.554099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.554318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.554427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.554623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.554714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.554921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.555013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.555220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.555334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.555527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.555620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.555832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.555952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.556159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.556249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.556470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.556577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.556779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.556880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.557076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.557176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.557375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.557467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.557687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.557786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.557980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.558077 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.558284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.558383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.558583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.558677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.558880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.558980 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.559214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.559323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.559521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.559654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.559820 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.559952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.560154 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.560330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.560469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.560641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.560772 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.561073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.561168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.561373 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.561468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.561677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.561795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.561992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.562110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.562300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.562440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.562604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.562806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.562898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.563160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.563328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.563529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.563658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.563846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.563990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.564188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.564287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.564492 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.564601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.564798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.564935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.565103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.565293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:26:35.565393 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.565637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.565730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.565976 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.566990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.567191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.567350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.567509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.567701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.567825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568192 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.568887 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.569819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570027 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570327 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.570899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571488 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571644 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571791 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.571988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.572953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.573245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.573411 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.573566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.573709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.573860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574027 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574199 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574373 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.574886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575444 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.575885 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576192 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576486 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.576967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577682 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.577968 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.578099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.578255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.578403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.578544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.578905 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.579008 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.579232 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.579481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.579669 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.579930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.580956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.581152 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.581451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.581548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.581755 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582055 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582156 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582365 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.582956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.583072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.583253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.583474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.583566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.583846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.584837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.585932 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586038 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586352 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.586842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587642 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.587762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.588971 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589588 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.589898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590194 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590296 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.590909 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.591096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.591241 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.591392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.591552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.591694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.592408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.592499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.592591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.592672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593326 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593326 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593734 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.593825 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594733 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.594843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.595072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.595161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.595401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.595491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.596824 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597056 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597404 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597688 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.597967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598479 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.598882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599183 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.599781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600727 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.600941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601078 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.601979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602178 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.602894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603393 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.603835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604636 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.604923 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605235 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.605875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606492 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.606996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607089 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.607902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608057 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608744 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.608957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609354 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.609863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.610926 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611082 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.611962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612114 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612455 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612579 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.612871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613732 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.613834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614431 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.614954 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.615949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616656 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616872 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.616975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.617901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.618846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619669 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.619769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.620929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621031 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621340 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621869 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.621969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.622941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623266 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623790 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.623883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.624820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625716 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.625828 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.626922 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627256 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.627962 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628630 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.628937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629027 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629254 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629865 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.629967 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630485 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630786 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.630879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631090 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.631815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632039 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.632977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633068 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633282 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.633927 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.634902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635244 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635746 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.635839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636181 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636366 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636663 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.636966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637366 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.637982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638785 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.638934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639085 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639564 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.639886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.640918 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641218 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.641945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642045 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.642980 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.643187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.643345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.643495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.643698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.643795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644716 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.644885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645027 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.645890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.646986 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647445 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.647981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648116 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648297 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648728 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.648942 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649343 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.649975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650317 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.650897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.651845 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.652985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.653901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654301 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.654912 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655422 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.655831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.656772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.657070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.657177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.657467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.657560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.657798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.658977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659588 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.659896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660824 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.660915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661131 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.661824 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662431 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.662949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.663041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.663255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.663369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.663652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.663884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664404 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.664931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665137 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665237 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.665870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666390 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.666998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667301 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.667887 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668057 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.668923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669746 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.669891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670046 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.670969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.671904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672126 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.672944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673247 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.673864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.674774 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.675943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676078 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676376 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.676877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.677834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.678982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.679930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.680961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681780 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.681882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682688 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.682993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.683905 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.684924 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685117 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.685886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.686927 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687259 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687580 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687682 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.687882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688254 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688360 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688660 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.688975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.689935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.690898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.691022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.691320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.691422 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.691635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.691741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.692994 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693538 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.693948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694450 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.694841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.695748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.696981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697303 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.697917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698102 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698684 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698776 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.698980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.699866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.700890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701721 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.701921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702237 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.702863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703462 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.703936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704138 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704769 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.704875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.705806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.706920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707523 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707613 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.707839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708483 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.708908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709111 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709733 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.709847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710663 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.710959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.711957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.712872 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713092 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713504 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.713817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714040 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714760 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.714972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.715096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.715312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.715620 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.715719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.715971 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.716995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.717201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.717302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.717439 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:26:35.717554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.717867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.718178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.718489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.718799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.719150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.719563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.719988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.720286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.720609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.721239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.721556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.721873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.722230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.722544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.722856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.723170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.723486 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.723798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.724133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.724467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.724803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.725138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.725473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.725788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.726125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.726469 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.726819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.727177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.727501 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.727818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.728157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.728477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.728995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.729329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.729684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.730011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.730353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.730696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.731042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.731393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.731700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.732031 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.732355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.732677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.733004 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.733349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.733684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.733989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.734310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.734619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.735264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.735609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.735933 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.736270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.736593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.736910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.737239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.737584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.737915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.738221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.738537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.738850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.739155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.739459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.739770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.740121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.740428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.740737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.741048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.741379 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.741711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.742027 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.742287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.742598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.742901 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.743204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.743511 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.743815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.744156 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.744483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.744795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.745118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.745432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.745736 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.746060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.746371 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.746708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.747037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.747398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.747741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.748078 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.748425 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.748760 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.749095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.749463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.749782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.750318 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.750699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.751025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.751361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.751693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.752028 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.752338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.752655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.752979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.753295 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.753608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.753920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.754230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.754544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.754856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.755168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.755478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.755787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.756121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.756432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.756744 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.757054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.757384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.757700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.758062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.758383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.758698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.759015 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.759331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.759644 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.759975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.760288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.760597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.760937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.761269 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.761600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.761926 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.762368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.762690 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.763009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.763335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.763666 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.764034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.764359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.764673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.764995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.765306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.765637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.765976 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.766331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.766654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.766960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.767266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.767571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.767880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.768224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.768538 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.768865 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.769168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.769476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.769780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.770091 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.770390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.770694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.771000 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.771302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.771636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.771902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.772224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.772530 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.772836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.773145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.773446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.773751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.774049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.774350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.774673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.775006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.775336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.775672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.776013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.776324 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.776665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.776984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.777311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.777643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.777955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.778049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO dbcounter [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Registered counter for database nova_api Aug 23 04:26:35.778305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.778636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.779152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.779283 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.779634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.780022 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.780385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.780646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.781004 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.781357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.781728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.782094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.782434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.782793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.783096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.783430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.783764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.784118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.784454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.784790 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.785104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.785413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.785728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.786079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.786371 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.786687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.787020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.787321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.787643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.787973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.788301 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.788624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.788972 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.789287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.789629 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.790019 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.790266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.790575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.791353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:26:35.791353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:26:35.798738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_db.sqlalchemy.engines [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.805707 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writer thread running {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:35.853868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO dbcounter [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Registered counter for database nova_api Aug 23 04:26:35.860322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.context [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),101fad6b-7e6e-45d6-8875-d41a29e76ec7(cell1) {{(pid=121224) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 04:26:35.864461 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:26:35.864920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:26:35.866478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:26:35.867209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:26:35.867642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:26:35.869911 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:26:35.871604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO dbcounter [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Registered counter for database nova_cell0 Aug 23 04:26:35.875126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_db.sqlalchemy.engines [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.875725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO dbcounter [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Registered counter for database nova_cell1 Aug 23 04:26:35.882480 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writer thread running {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:35.882992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_db.sqlalchemy.engines [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.884768 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_db.sqlalchemy.engines [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.890640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writer thread running {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:35.892845 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writer thread running {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:35.939396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.context [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),101fad6b-7e6e-45d6-8875-d41a29e76ec7(cell1) {{(pid=121223) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 04:26:35.943508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:26:35.944010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:26:35.945584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:26:35.946320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:26:35.946764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:26:35.948791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:26:35.950962 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO dbcounter [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Registered counter for database nova_cell0 Aug 23 04:26:35.955407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO dbcounter [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Registered counter for database nova_cell1 Aug 23 04:26:35.962982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_db.sqlalchemy.engines [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.964393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_db.sqlalchemy.engines [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:35.971852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writer thread running {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:35.973170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writer thread running {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:36.037144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO dbcounter [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Registered counter for database nova_cell0 Aug 23 04:26:36.043780 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_db.sqlalchemy.engines [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:36.048814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writer thread running {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:36.120750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO dbcounter [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Registered counter for database nova_cell0 Aug 23 04:26:36.129894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_db.sqlalchemy.engines [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:26:36.135180 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writer thread running {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:26:36.365581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: WARNING keystonemiddleware.auth_token [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:26:36.372875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: WARNING keystonemiddleware.auth_token [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:26:36.450133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: WARNING keystonemiddleware.auth_token [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:26:36.457721 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: WARNING keystonemiddleware.auth_token [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:26:36.739095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: WARNING keystonemiddleware.auth_token [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:26:36.745425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: WARNING keystonemiddleware.auth_token [None req-37b6f268-6d64-43fa-a217-70b577728bc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:26:36.751553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560340f879c0 pid: 121224 (default app) Aug 23 04:26:36.807303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: WARNING keystonemiddleware.auth_token [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 04:26:36.813401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: WARNING keystonemiddleware.auth_token [None req-6984bb5b-e8a0-49b9-bb6c-05102822e9b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 04:26:36.818966 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560340f879c0 pid: 121223 (default app) Aug 23 04:27:11.123627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.125959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.128518 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.130714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.985741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.986624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.987737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.993737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:12.683811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1de038ea-f0a2-45b7-a9b3-636809c7adde tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Action: 'create', calling method: .version_select at 0x7f9c1cee8700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1600783868"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-04e3d0e0-c30b-4f3f-af6e-dd63667cc390 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Action: 'create', calling method: .version_select at 0x7f9c1cf665e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1371899381", "metadata": {"Type": "work"}}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-04e3d0e0-c30b-4f3f-af6e-dd63667cc390 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 122 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.117625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1371899381", "metadata": {"Type": "work"}}} Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.123502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1371899381', 'metadata': {'Type': 'work'}}}} Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise error Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.124941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 04:27:13.128590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-04e3d0e0-c30b-4f3f-af6e-dd63667cc390 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-04e3d0e0-c30b-4f3f-af6e-dd63667cc390 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.118533 Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Aug 23 04:27:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0ef408a7-b8db-4690-89cd-76552b3cc899 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Action: 'create', calling method: .version_select at 0x7f9c1cf66670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-413180052", "metadata": {"Type": "work"}}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0ef408a7-b8db-4690-89cd-76552b3cc899 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 04:27:13.129724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 119 Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.130290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-413180052", "metadata": {"Type": "work"}}} Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-413180052', 'metadata': {'Type': 'work'}}}} Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise error Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi '0' Aug 23 04:27:13.136553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.139598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0ef408a7-b8db-4690-89cd-76552b3cc899 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0ef408a7-b8db-4690-89cd-76552b3cc899 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010039 Aug 23 04:27:13.143487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Aug 23 04:27:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:27:13.144785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3a4a8b28-fbfb-455d-b101-500ecb0bd3c5 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Action: 'create', calling method: .version_select at 0x7f9c1ce231f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-387380183", "metadata": {"Type": "work"}}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3a4a8b28-fbfb-455d-b101-500ecb0bd3c5 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 118 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.148029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-387380183", "metadata": {"Type": "work"}}} Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.149368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-387380183', 'metadata': {'Type': 'work'}}}} Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise error Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi '' Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.150126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 04:27:13.151684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 04:27:13.153535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 04:27:13.153535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.153535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3a4a8b28-fbfb-455d-b101-500ecb0bd3c5 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.153535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3a4a8b28-fbfb-455d-b101-500ecb0bd3c5 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020199 Aug 23 04:27:13.160667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Aug 23 04:27:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:27:13.177900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-86d698a7-7616-435d-a20b-31212d9191be tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Calling method '.version_select at 0x7f9c1ce23b80>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:13.608534 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-86d698a7-7616-435d-a20b-31212d9191be tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] HTTP exception thrown: Volume tempest-invalid-1696679199 could not be found. Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-86d698a7-7616-435d-a20b-31212d9191be tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1696679199 HTTP/1.1 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.623803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Volume tempest-invalid-1696679199 could not be found. Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'tempest-invalid-1696679199'} Aug 23 04:27:13.625417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1696679199 could not be found. (HTTP 404) (Request-ID: req-c8e31f11-5229-4e8a-a716-44b50c4d9a96) Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.626239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:13.627957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1696679199 could not be found. Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:13.629286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1696679199 could not be found. Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1696679199 could not be found. Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-86d698a7-7616-435d-a20b-31212d9191be tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 404 to user: Volume tempest-invalid-1696679199 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.630748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-86d698a7-7616-435d-a20b-31212d9191be tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1696679199" status: 404 len: 99 microversion: 2.1 time: 0.466423 Aug 23 04:27:13.637636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Aug 23 04:27:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1696679199 => generated 99 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 04:27:13.651367 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-21f68038-81a9-4766-aaa9-8112aaf17ba2 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012454 Aug 23 04:27:13.661943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Aug 23 04:27:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 04:27:13.669012 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-94609ac1-7000-47a3-8e93-ec00281a113e tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005294 Aug 23 04:27:13.669871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Aug 23 04:27:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 04:27:13.681271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f2f63b17-309f-4c22-8580-093a913a649a tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Calling method '.version_select at 0x7f9c1cd584c0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:13.776358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-f2f63b17-309f-4c22-8580-093a913a649a tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] HTTP exception thrown: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f2f63b17-309f-4c22-8580-093a913a649a tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/os-volumes/d0c7cb98-05fc-4b26-9df3-e659f7099c90 HTTP/1.1 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.778385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'd0c7cb98-05fc-4b26-9df3-e659f7099c90'} Aug 23 04:27:13.779635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. (HTTP 404) (Request-ID: req-1470ac4d-0e82-4b5e-bd64-8cfc1759614a) Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.781474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:13.782581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 04:27:13.783624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f2f63b17-309f-4c22-8580-093a913a649a tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 404 to user: Volume d0c7cb98-05fc-4b26-9df3-e659f7099c90 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f2f63b17-309f-4c22-8580-093a913a649a tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d0c7cb98-05fc-4b26-9df3-e659f7099c90" status: 404 len: 109 microversion: 2.1 time: 0.102613 Aug 23 04:27:13.796147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:27:13 2022] DELETE /compute/v2.1/os-volumes/d0c7cb98-05fc-4b26-9df3-e659f7099c90 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:13.798817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-daeaabf5-19b1-4a30-82c6-74c13699c531 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Calling method '.version_select at 0x7f9c1cd58820>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:13.886492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-daeaabf5-19b1-4a30-82c6-74c13699c531 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] HTTP exception thrown: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-daeaabf5-19b1-4a30-82c6-74c13699c531 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Request method failure captured: Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/os-volumes/93b0642c-793f-4526-8a19-2fc4e1600dc5 HTTP/1.1 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcffDC602H43fj7Hu9FKODzY6u6rNQtx8yuyMTO_wlD5C4x--yFEBs1y6MU0g99hyAiUbknzl1vT9sqaaW9vY8XesuFmqgjr7zHUtSADfZLLJGJIkxtbPwFYZbo8BLDPa2OnWaGo8CKwk8QnKr41jkO1Rw7ehRgAews7cjhFDLOXC8 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:13.892267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_934feb1c3d2643d3b65358816dcedf3e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/934feb1c3d2643d3b65358816dcedf3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 934feb1c3d2643d3b65358816dcedf3e Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesNegativeTest-543876667 Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 0cda5ab380d74e3d901f6675266c4c2d Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesNegativeTest-543876667-project Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '93b0642c-793f-4526-8a19-2fc4e1600dc5'} Aug 23 04:27:13.893854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. (HTTP 404) (Request-ID: req-d9eaad65-5c3f-4ae9-aedb-3eca44c1a566) Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.894698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:13.895819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 04:27:13.898076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-daeaabf5-19b1-4a30-82c6-74c13699c531 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] Returning 404 to user: Volume 93b0642c-793f-4526-8a19-2fc4e1600dc5 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-daeaabf5-19b1-4a30-82c6-74c13699c531 tempest-VolumesNegativeTest-543876667 tempest-VolumesNegativeTest-543876667-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/93b0642c-793f-4526-8a19-2fc4e1600dc5" status: 404 len: 109 microversion: 2.1 time: 0.108022 Aug 23 04:27:13.899696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:13 2022] GET /compute/v2.1/os-volumes/93b0642c-793f-4526-8a19-2fc4e1600dc5 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:14.535280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1de038ea-f0a2-45b7-a9b3-636809c7adde tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.434696 Aug 23 04:27:14.537236 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 1/9] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Aug 23 04:27:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 04:27:14.551584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-756d0736-c8bf-4cc6-b1c8-fb37ad75ba56 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1ce23f70>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:14.668126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-756d0736-c8bf-4cc6-b1c8-fb37ad75ba56 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 200 len: 345 microversion: 2.1 time: 0.121030 Aug 23 04:27:14.668942 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:14 2022] GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:15.689471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-80452c0c-1869-47cc-926f-3c37dfd75668 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdbd550>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:15.799587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-80452c0c-1869-47cc-926f-3c37dfd75668 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 200 len: 346 microversion: 2.1 time: 0.120560 Aug 23 04:27:15.800325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 2/11] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:15 2022] GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:15.812961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a1a73665-6010-485f-a457-e0f0578c9f58 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Action: 'create', calling method: .version_select at 0x7f9c1cd58940>, body: {"snapshot": {"volume_id": "67e11ba3-7a07-4083-ad4a-b84f42ead5f3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1154783737"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:16.289190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a1a73665-6010-485f-a457-e0f0578c9f58 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.480136 Aug 23 04:27:16.289749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 10/12] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Aug 23 04:27:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:16.300315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7541b9ac-f2f0-452a-994d-c21a58120b06 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdbdc10>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:16.444077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7541b9ac-f2f0-452a-994d-c21a58120b06 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 287 microversion: 2.1 time: 0.147536 Aug 23 04:27:16.444647 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 3/13] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:16 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:16.464192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-610e3c03-a2c2-4a9c-8023-d5e94bd99b9a tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd5a280>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:16.555803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-610e3c03-a2c2-4a9c-8023-d5e94bd99b9a tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.104087 Aug 23 04:27:16.556700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 11/14] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Aug 23 04:27:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:16.568844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-22513241-cd47-40a9-a40b-8b6bbd0e1ba0 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdd53a0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:16.617530 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-22513241-cd47-40a9-a40b-8b6bbd0e1ba0 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 287 microversion: 2.1 time: 0.052850 Aug 23 04:27:16.623130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 4/15] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:16 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:17.630384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5c8bddbc-4804-4947-8a8d-a5ff807d6c28 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd62550>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:17.683438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5c8bddbc-4804-4947-8a8d-a5ff807d6c28 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 287 microversion: 2.1 time: 0.056704 Aug 23 04:27:17.688762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 12/16] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:17 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:18.696515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6b72edb3-b9bd-46ba-9135-d2eb143bd072 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdbdc10>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:18.769056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6b72edb3-b9bd-46ba-9135-d2eb143bd072 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 287 microversion: 2.1 time: 0.075350 Aug 23 04:27:18.770127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 5/17] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:18 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:19.782171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4a028391-f0e1-462d-a18f-e08d62dc77e0 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd5a700>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:19.872840 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4a028391-f0e1-462d-a18f-e08d62dc77e0 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 288 microversion: 2.1 time: 0.090529 Aug 23 04:27:19.879801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 13/18] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:19 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:27:19.893750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-500e90bd-5a6b-47da-813f-3afbaec6e940 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdbd550>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:20.076958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-500e90bd-5a6b-47da-813f-3afbaec6e940 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 202 len: 0 microversion: 2.1 time: 0.194447 Aug 23 04:27:20.077897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 6/19] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Aug 23 04:27:19 2022] DELETE /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:27:20.089818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c416d94d-5d9d-4317-b7f0-51317a946097 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd58f70>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:20.145025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c416d94d-5d9d-4317-b7f0-51317a946097 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 200 len: 287 microversion: 2.1 time: 0.061093 Aug 23 04:27:20.148341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 14/20] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:20 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:21.161925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-86fe79c5-9119-467b-b3ce-91ac497eee8c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdd55e0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:21.247799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-86fe79c5-9119-467b-b3ce-91ac497eee8c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] HTTP exception thrown: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-86fe79c5-9119-467b-b3ce-91ac497eee8c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Request method failure captured: Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 HTTP/1.1 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFce_j1BVHegnZUtoFfqG8npGFcs8giNw7K8atFgBb34SMI8VFPaShNou1U-bRUBHTfrbxICcD0noJgaG7OpZ6FJK9VGMBWJ_xHzqJQIuvtrd6AzFAWSUqlzJDH94AEsqgxkAuSkK-scnJO_weeUAOgFfwBUxcE5jC5DscNJc4e7BkE Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:27:21.253770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7c99e53f92aa4ceb91b74dfeac159107", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: b85578c3e7de4c78b2e2da0000d6f332 Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'b44776a5-b2e4-4465-b9d6-3de2fc2b76e6'} Aug 23 04:27:21.254916 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. (HTTP 404) (Request-ID: req-a99152b3-38ee-4e42-8b0a-3e8444ec16e3) Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.255560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:21.256421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 04:27:21.257380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. Aug 23 04:27:21.258277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:21.261545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-86fe79c5-9119-467b-b3ce-91ac497eee8c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Returning 404 to user: Snapshot b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:21.266465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-86fe79c5-9119-467b-b3ce-91ac497eee8c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6" status: 404 len: 111 microversion: 2.1 time: 0.107705 Aug 23 04:27:21.273081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 7/21] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Aug 23 04:27:21 2022] GET /compute/v2.1/os-snapshots/b44776a5-b2e4-4465-b9d6-3de2fc2b76e6 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:21.294400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e4dd7ece-ef17-454f-9c4f-e7449285149e tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd58790>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:21.481387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e4dd7ece-ef17-454f-9c4f-e7449285149e tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 202 len: 0 microversion: 2.1 time: 0.203769 Aug 23 04:27:21.482204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 15/22] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:27:21 2022] DELETE /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:27:21.490933 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-31202cd0-f097-48d3-ad54-d29d430a1fa1 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cdd5d30>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:21.595296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-31202cd0-f097-48d3-ad54-d29d430a1fa1 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 200 len: 345 microversion: 2.1 time: 0.108342 Aug 23 04:27:21.601000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 8/23] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:21 2022] GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:22.618631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cb34e659-b6e7-4cb3-9188-3aa733acc98c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd588b0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:22.666970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-cb34e659-b6e7-4cb3-9188-3aa733acc98c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] HTTP exception thrown: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cb34e659-b6e7-4cb3-9188-3aa733acc98c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Request method failure captured: Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 HTTP/1.1 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFce_j1BVHegnZUtoFfqG8npGFcs8giNw7K8atFgBb34SMI8VFPaShNou1U-bRUBHTfrbxICcD0noJgaG7OpZ6FJK9VGMBWJ_xHzqJQIuvtrd6AzFAWSUqlzJDH94AEsqgxkAuSkK-scnJO_weeUAOgFfwBUxcE5jC5DscNJc4e7BkE Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:22.668943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7c99e53f92aa4ceb91b74dfeac159107", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: b85578c3e7de4c78b2e2da0000d6f332 Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '67e11ba3-7a07-4083-ad4a-b84f42ead5f3'} Aug 23 04:27:22.669936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. (HTTP 404) (Request-ID: req-c20ef35f-f41f-4249-817a-6eccf1fe27b8) Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.670562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:22.671391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 04:27:22.672508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cb34e659-b6e7-4cb3-9188-3aa733acc98c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Returning 404 to user: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cb34e659-b6e7-4cb3-9188-3aa733acc98c tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 404 len: 109 microversion: 2.1 time: 0.056170 Aug 23 04:27:22.675468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:22 2022] GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:22.685332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5f45d59f-e330-432b-9731-f5eb5e1c0684 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd39430>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:22.772615 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-5f45d59f-e330-432b-9731-f5eb5e1c0684 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] HTTP exception thrown: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5f45d59f-e330-432b-9731-f5eb5e1c0684 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Request method failure captured: Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: DELETE /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 HTTP/1.1 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFce_j1BVHegnZUtoFfqG8npGFcs8giNw7K8atFgBb34SMI8VFPaShNou1U-bRUBHTfrbxICcD0noJgaG7OpZ6FJK9VGMBWJ_xHzqJQIuvtrd6AzFAWSUqlzJDH94AEsqgxkAuSkK-scnJO_weeUAOgFfwBUxcE5jC5DscNJc4e7BkE Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:27:22.774889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7c99e53f92aa4ceb91b74dfeac159107", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: b85578c3e7de4c78b2e2da0000d6f332 Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '67e11ba3-7a07-4083-ad4a-b84f42ead5f3'} Aug 23 04:27:22.776112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. (HTTP 404) (Request-ID: req-5827e77a-2975-476f-9d7e-ca4d75aefdbd) Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.776847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 04:27:22.780857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 04:27:22.782050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5f45d59f-e330-432b-9731-f5eb5e1c0684 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Returning 404 to user: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5f45d59f-e330-432b-9731-f5eb5e1c0684 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 404 len: 109 microversion: 2.1 time: 0.095043 Aug 23 04:27:22.783052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 9/25] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:27:22 2022] DELETE /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:22.785150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4511b136-832b-4792-9ce2-29b6cc12f4c4 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Calling method '.version_select at 0x7f9c1cd58af0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:22.852234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-4511b136-832b-4792-9ce2-29b6cc12f4c4 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] HTTP exception thrown: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4511b136-832b-4792-9ce2-29b6cc12f4c4 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Request method failure captured: Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 HTTP/1.1 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFce_j1BVHegnZUtoFfqG8npGFcs8giNw7K8atFgBb34SMI8VFPaShNou1U-bRUBHTfrbxICcD0noJgaG7OpZ6FJK9VGMBWJ_xHzqJQIuvtrd6AzFAWSUqlzJDH94AEsqgxkAuSkK-scnJO_weeUAOgFfwBUxcE5jC5DscNJc4e7BkE Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:27:22.855369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7c99e53f92aa4ceb91b74dfeac159107", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7c99e53f92aa4ceb91b74dfeac159107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 7c99e53f92aa4ceb91b74dfeac159107 Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-653231050 Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: b85578c3e7de4c78b2e2da0000d6f332 Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesSnapshotsTestJSON-653231050-project Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '67e11ba3-7a07-4083-ad4a-b84f42ead5f3'} Aug 23 04:27:22.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. (HTTP 404) (Request-ID: req-e38070f7-e64c-48bc-9f35-34606685cba1) Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.857358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:27:22.861383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 04:27:22.862255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4511b136-832b-4792-9ce2-29b6cc12f4c4 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] Returning 404 to user: Volume 67e11ba3-7a07-4083-ad4a-b84f42ead5f3 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4511b136-832b-4792-9ce2-29b6cc12f4c4 tempest-VolumesSnapshotsTestJSON-653231050 tempest-VolumesSnapshotsTestJSON-653231050-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3" status: 404 len: 109 microversion: 2.1 time: 0.075710 Aug 23 04:27:22.863167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 17/26] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:27:22 2022] GET /compute/v2.1/os-volumes/67e11ba3-7a07-4083-ad4a-b84f42ead5f3 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:25.420172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d81e6f0b-fb6a-45b9-8cae-0e43068c9844 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: .version_select at 0x7f9c1cdd5a60>, body: {"keypair": {"name": "tempest-keypair-1578915449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdcw6rROFl2xV7b3z1aCcIxXUJz8/2BHCZDnKEQT/pDP+mCx1Q/V6uH7RJ5jFJ5knTR3CBCSgqPXUp//PRtQQP0nroIyMrHz1xQa5zhg4qLX/OMCYFTojjCfCVYediS8w=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:25.540100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-d81e6f0b-fb6a-45b9-8cae-0e43068c9844 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for project fa6589185abe4af1b3d0cba6f0699538. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:25.565357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-d81e6f0b-fb6a-45b9-8cae-0e43068c9844 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for user c8fa0859e5c14c53a5a2473c95efe152 and project fa6589185abe4af1b3d0cba6f0699538. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:25.709190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d81e6f0b-fb6a-45b9-8cae-0e43068c9844 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.559506 Aug 23 04:27:25.710273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 10/27] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Aug 23 04:27:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 561 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 04:27:31.035453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b12c9de8-cc0f-4212-9b86-f8e55b234b04 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: .version_select at 0x7f9c1cd58550>, body: {"keypair": {"name": "tempest-keypair-830904293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+hjDkB74AIzBUD/Kw/nYpTBmnyFpL4rhZN/jstkm93CG4iIuXkrW5KOYlmpv574oieWDVlNjdMIZMkGHqwdcLxJwEXM2skJKzZAAhpGyIAREfTa1s1Z/0ORnO9YLhQEg=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:31.213983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-b12c9de8-cc0f-4212-9b86-f8e55b234b04 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for project 620abd3a734b4502afa795d2cc58dadf. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:31.237682 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-b12c9de8-cc0f-4212-9b86-f8e55b234b04 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for user 658ce95360454ea1a96a22af310e5a4f and project 620abd3a734b4502afa795d2cc58dadf. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:31.365538 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b12c9de8-cc0f-4212-9b86-f8e55b234b04 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.611326 Aug 23 04:27:31.366128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 18/28] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:27:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:32.713176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1707510427", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "networks": [{"uuid": "a5e934c1-aa9a-452d-85fb-a285da26e1ae"}]}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:32.930217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1301523948", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:32.955617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] validate_networks() for [('a5e934c1-aa9a-452d-85fb-a285da26e1ae', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:33.108599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] validate_networks() for [('fd742f53-022c-4e81-afc1-52562ecc925b', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:35.603900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=4 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:36.280590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:36.281008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:36.281769 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:36.282237 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:36.282762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:36.297318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:36.298352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:36.314572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:36.315075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:36.315449 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:36.316275 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:36.316882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:36.321066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:36.324986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:36.325660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:36.329957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:36.345787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:36.346836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:36.354891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:36.357443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:36.358068 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:36.373150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:36.454448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Getting quotas for project 3d3169d3b318421fab1d473a51637437. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:36.481248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:36.482033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Getting quotas for user bafdb895190e45ba96e71fd348c41c3f and project 3d3169d3b318421fab1d473a51637437. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:36.487119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for user 820b9a99be574eb8b09629988c4c59c0 and project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:36.506502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:36.512713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:36.515842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:36.520472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:36.684635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-098f3772-e5a0-4268-826a-19b9c7e89d03 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.323583 Aug 23 04:27:36.686238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 11/29] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:27:36.694973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-414afb2b-723d-49a8-944b-9da360d680e9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.900559 Aug 23 04:27:36.695990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 19/30] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:27:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 04:27:36.708246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-167847626", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6add0727-6c98-4d08-a7e7-3e117fdd2353"}], "security_groups": [{"name": "tempest-securitygroup--1094529803"}], "key_name": "tempest-keypair-1578915449", "user_data": "}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:37.018395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] validate_networks() for [('6add0727-6c98-4d08-a7e7-3e117fdd2353', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:37.202830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cddd2c81-9013-4dfd-ab35-e48bb7cf1a3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: .version_select at 0x7f9c1c464820>, body: {"keypair": {"name": "tempest-keypair-1475356655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWUJ0Stequ5rFWoIJwb0WPuC1Uv+H8w3+Lxe85aVSRpozNDo+H8jl0cMYJC/SVDeai5N60qUHZSVABo0k/HUe7zgFSgCSHoIowxZY3a9lDD0sE97S4QK8laYh63Ej6wkQ=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:37.231352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-cddd2c81-9013-4dfd-ab35-e48bb7cf1a3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:37.247857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-cddd2c81-9013-4dfd-ab35-e48bb7cf1a3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:37.301459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cddd2c81-9013-4dfd-ab35-e48bb7cf1a3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.613662 Aug 23 04:27:37.311119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 12/31] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:27:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:37.326142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-898789073", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a554d691-3edb-400b-bdf3-7ffd755600af"}], "security_groups": [{"name": "tempest-securitygroup--1661417019"}], "key_name": "tempest-keypair-830904293", "user_data": "}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:38.225356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] validate_networks() for [('a554d691-3edb-400b-bdf3-7ffd755600af', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:38.571708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:38.572777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:38.573796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:38.574945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:38.575526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:38.597104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:38.597947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:38.601050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:38.603787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:38.605411 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:38.607381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:38.660246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for project fa6589185abe4af1b3d0cba6f0699538. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:38.676288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for user c8fa0859e5c14c53a5a2473c95efe152 and project fa6589185abe4af1b3d0cba6f0699538. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:38.724473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:38.735447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:38.912387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-92c32054-09f7-4c9b-9edc-13d6c103a790 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.214859 Aug 23 04:27:38.913927 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 20/32] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Aug 23 04:27:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 04:27:38.953755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-669146f0-5b26-40fe-8b9e-b67cbcbeb67a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:38.955438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-669146f0-5b26-40fe-8b9e-b67cbcbeb67a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:39.389706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-669146f0-5b26-40fe-8b9e-b67cbcbeb67a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:39.440466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-669146f0-5b26-40fe-8b9e-b67cbcbeb67a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1215 microversion: 2.1 time: 0.524191 Aug 23 04:27:39.443659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 21/33] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:38 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1215 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:39.456809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:39.459259 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:39.510764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:39.514013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:39.514761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:39.518024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:39.520539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:39.521413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.208252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:40.249437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-aa7f1339-9d77-4aa6-b624-734af41895ae tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1218 microversion: 2.1 time: 0.804474 Aug 23 04:27:40.256813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 22/34] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:39 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1218 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:40.280346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:40.288533 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:40.338316 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.341190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.342900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.346906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.348817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.349365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.496786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:40.503572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:40.505581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:40.506871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4c3be5c8-2290-49b3-88b6-be1012743c4e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1285 microversion: 2.20 time: 0.241019 Aug 23 04:27:40.507749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 23/35] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:40 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:40.514494 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:40.515400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:40.524565 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.525421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.534246 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:40.535519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:40.537064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:40.538166 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:40.538940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:40.549601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.551681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.554325 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.555173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.562948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.564760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.566033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.577108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:40.579216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:40.580435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:40.652410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for project 620abd3a734b4502afa795d2cc58dadf. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:40.660295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for user 658ce95360454ea1a96a22af310e5a4f and project 620abd3a734b4502afa795d2cc58dadf. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:40.688361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:40.692732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:40.789573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-df93ab6d-ca2e-45ef-ac94-569533536693 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.476891 Aug 23 04:27:40.790723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 13/36] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:27:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:27:40.796149 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1287552197", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:40.880146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:40.894012 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-26f517e3-0251-44e5-98ea-ecc7692bbbf7 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1267 microversion: 2.1 time: 0.382711 Aug 23 04:27:40.896651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 24/37] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:40 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:40.917478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c0f4cd75-b717-42e9-afe1-96781cf67a12 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:40.918112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c0f4cd75-b717-42e9-afe1-96781cf67a12 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:40.920681 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] validate_networks() for [('fd742f53-022c-4e81-afc1-52562ecc925b', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:41.241229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c0f4cd75-b717-42e9-afe1-96781cf67a12 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:41.251930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c0f4cd75-b717-42e9-afe1-96781cf67a12 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1236 microversion: 2.1 time: 0.348325 Aug 23 04:27:41.254416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 25/38] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:40 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1236 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:41.531224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:41.538963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:41.573376 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:41.576306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:41.580772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:41.586160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:41.586661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:41.587096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:41.877915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:41.897109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:41.909483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:41.913214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ceac3db7-d326-409a-83cf-d8010f141e66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1341 microversion: 2.20 time: 0.383789 Aug 23 04:27:41.918827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 26/39] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:41 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:27:41.941743 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:41.942352 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:41.959797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:41.976446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:41.976960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:41.978204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:41.978204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:41.978565 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:42.283389 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:42.297460 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-863e5645-09b4-4aee-9cb9-582d48dfac46 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1273 microversion: 2.1 time: 0.374290 Aug 23 04:27:42.298503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 27/40] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:41 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:42.319427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:42.320383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:42.339163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:42.340182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:42.340786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:42.345188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:42.346149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:42.348288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:42.810545 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:42.825920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-49b04dba-f821-4af5-9841-446efe289573 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1232 microversion: 2.1 time: 0.526252 Aug 23 04:27:42.828719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 28/41] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:42 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1232 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:42.966361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:42.967226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:42.981046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:42.983592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:42.984451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:42.985317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:42.988133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:42.990605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:43.473309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:43.494447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:43.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:43.514778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5427629d-bc80-4cc8-a4e9-f9e1b47903f7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1339 microversion: 2.20 time: 0.555111 Aug 23 04:27:43.518307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 29/42] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:42 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1339 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:43.531799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-961360006", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c6be732-b40b-47aa-8b96-da7512121793"}], "security_groups": [{"name": "tempest-securitygroup--604093"}], "key_name": "tempest-keypair-1475356655", "user_data": "}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:43.851333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:43.851933 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:43.852549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:43.853098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:43.853607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:43.854113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] validate_networks() for [('8c6be732-b40b-47aa-8b96-da7512121793', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:27:43.880038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:43.880688 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:43.881260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:43.882118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:43.882708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:43.883322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:43.928177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:43.936452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for user 820b9a99be574eb8b09629988c4c59c0 and project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:43.967417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:43.969813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:44.071056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5ed9b396-339f-4821-8dfd-679c31b34a60 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.279105 Aug 23 04:27:44.072015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 14/43] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:27:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:27:44.087417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:44.089663 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:44.152489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:44.154306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:44.156075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:44.158682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:44.160842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:44.162200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:44.632118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:44.678083 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-21428e1a-c219-44c1-a9ed-3cc1c5eedea4 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1273 microversion: 2.1 time: 0.602150 Aug 23 04:27:44.680800 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 15/44] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:44 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:44.697224 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:44.698351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:44.711938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:44.712861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:44.713507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:44.714813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:44.715901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:44.717708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.127678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:45.136243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f99428f1-3cb8-4c62-9e3e-69928dc87931 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1294 microversion: 2.1 time: 0.453441 Aug 23 04:27:45.149930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 16/45] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:44 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1294 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:45.159881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:45.160764 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:45.170228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.174453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.175025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.177308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.179162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.179854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.366470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:45.376368 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ff1c8443-1a60-47cd-9b82-15ae35636329 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1226 microversion: 2.1 time: 0.222520 Aug 23 04:27:45.380289 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 17/46] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:45 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:45.392700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:45.393323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:45.409820 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.410531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.411113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.412005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.412591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.413289 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.650495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:45.664624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:45.666568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:45.667838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fcb360b1-b9e3-4126-9af9-7fe75e130bdc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1339 microversion: 2.20 time: 0.286652 Aug 23 04:27:45.671232 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 18/47] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:45 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1339 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:45.704433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:45.705156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:45.717421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.718111 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.720748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.722557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.723203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.723757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.737148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:27:45.737677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:27:45.738183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:27:45.738659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:27:45.739133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:27:45.762443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.763053 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.763792 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.764740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:45.765214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:45.767416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:45.802472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:27:45.826475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:27:45.848402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:27:45.851821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:27:45.981232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e868df07-ac47-4d00-a05f-91b867424be0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 2.461563 Aug 23 04:27:45.984655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 30/48] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:27:43 2022] POST /compute/v2.1/servers => generated 398 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:27:45.998195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9ce45605-8c92-4021-95e9-5ea59a260deb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:45.999118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9ce45605-8c92-4021-95e9-5ea59a260deb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:46.127412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:46.143180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a33a6231-b297-4cb8-a02f-45cb17e82634 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.447146 Aug 23 04:27:46.164350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 19/49] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:45 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:27:46.188292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:46.190812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:46.211229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:46.211978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:46.214123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:46.218562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:46.219346 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:46.220721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:46.501499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9ce45605-8c92-4021-95e9-5ea59a260deb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:46.528697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9ce45605-8c92-4021-95e9-5ea59a260deb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1241 microversion: 2.1 time: 0.535573 Aug 23 04:27:46.533165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 31/50] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:45 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1241 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:27:46.575579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:46.576226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:46.619763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:46.642261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:46.642746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:46.643508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:46.644003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:46.644428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:47.041186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:47.053293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f8ff1c26-8949-474c-a3a6-07acaba2be63 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1292 microversion: 2.1 time: 0.506085 Aug 23 04:27:47.056555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 32/51] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:46 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1292 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:47.092769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:47.101216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:47.115358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:47.127163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:47.131299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:47.135557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:47.137171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:47.141646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:47.720016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:47.736086 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b7130d2e-f19d-4752-b978-0398d9015cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1294 microversion: 2.1 time: 1.563875 Aug 23 04:27:47.737321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 20/52] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:46 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1294 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:47.744815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:47.745818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:47.756915 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:47.769080 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:47.774255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:47.779464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:47.780805 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:47.783660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:48.709005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:48.718281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:48.742162 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:48.743530 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-add78246-20af-47ad-8fba-a04312ab674d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 1.664009 Aug 23 04:27:48.744587 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 33/53] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:47 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:48.768959 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:48.769876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:48.778606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:48.779627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:48.780351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:48.781822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:48.782567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:48.783321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:48.972576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:48.983114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-33354126-681d-49ed-abdf-defec0c35475 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 1.243683 Aug 23 04:27:49.010147 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 21/54] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:47 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:49.050018 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:49.059945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:49.077748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.078536 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.085354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:49.086452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.087098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.095119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:49.211456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:49.229031 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e1ebd4ad-e75b-4f3c-a7d4-4072e84ed991 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1301 microversion: 2.1 time: 0.482823 Aug 23 04:27:49.248746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 34/55] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:48 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1301 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:49.254014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:49.255382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:49.263197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.263843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.266445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:49.267500 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.268131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.268706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:49.679718 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:49.691418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d11b3d8b-1bcb-4f9e-b923-86dd071d4858 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1280 microversion: 2.1 time: 0.679856 Aug 23 04:27:49.697397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 22/56] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:49 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1280 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:49.774119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:49.777134 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:49.790875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.791729 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.792435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:49.793282 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:49.793937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:49.794504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:50.089847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:50.098279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b9a30fec-7e52-4e31-8831-44909c49cd3a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.848101 Aug 23 04:27:50.112315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 35/57] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:49 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:50.119485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:50.120033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:50.129651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:50.154132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:50.154416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:50.154782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:50.155484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:50.165708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:50.167249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.096284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.113087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b6c79e67-95ad-436d-b715-9b3c5b73823f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 1.009671 Aug 23 04:27:51.114279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 36/58] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:50 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:51.128943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:51.129822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:51.134490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.137871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.145958 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.146672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.147587 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.148234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.148799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.151612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.160968 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.162161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1b67564d-0424-485f-b83a-336f582b5f4a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 1.391997 Aug 23 04:27:51.167985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 23/59] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:49 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:27:51.185640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:51.190995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:51.196110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:51.211154 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.211823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.212332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.213330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.214178 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.215186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.263902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.272291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-042516e1-0bc9-4eff-96a4-b58c8426b0f9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1299 microversion: 2.1 time: 0.156780 Aug 23 04:27:51.272863 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 37/60] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:51 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:51.285346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:51.302561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:51.315477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.316435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.317655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.318725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:51.319397 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:51.320060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:51.402685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.419522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-666b1f11-d811-4934-9466-8e08be66ae77 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1280 microversion: 2.1 time: 0.248571 Aug 23 04:27:51.423416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 24/61] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:51 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:51.645861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:51.656719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-574c57cc-15e9-4c92-b976-57712723b683 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.375244 Aug 23 04:27:51.657902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 38/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:51 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:52.139589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:52.140266 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:52.154534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.155217 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.155815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:52.157384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.160593 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.161363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:52.192399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:52.193747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:52.212020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.213821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.217218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:52.220643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.223217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.228919 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:52.722961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:52.736548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7472444d-3706-4e5f-93b7-a95282e70801 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.602045 Aug 23 04:27:52.744890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 25/63] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:52 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:52.750706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:52.759946 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:52.776901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.779963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.781252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:52.782964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:52.784532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:52.788310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:53.403245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:53.416842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:53.420299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:53.424730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9f92652c-248d-4e32-bf71-b23bc2f789cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 1.237007 Aug 23 04:27:53.441335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 39/64] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:52 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:53.455993 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:53.460152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:53.476623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:53.487654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:53.489744 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:53.490168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-322f4b7f-7edf-48ed-a4e2-49206290c42c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1299 microversion: 2.1 time: 0.740438 Aug 23 04:27:53.492848 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:53.494131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:53.494864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:53.496525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:53.507688 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 26/65] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:52 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1299 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:53.523112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:53.524189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:53.538223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:53.541265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:53.541930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:53.542787 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:53.544555 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:53.545955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:53.590123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:53.862739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:53.871218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1930e9e5-d7f4-43fa-94cd-faffe4a3344b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.428235 Aug 23 04:27:53.871787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 40/66] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:53 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:53.905706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:53.955351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=22 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:54.234544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:54.259829 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.264125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.264789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.322601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Creating event network-changed:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:27:54.328452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121223) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 04:27:54.330169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-74d98d02-2f1c-4fa1-904f-f42d6c10e526 req-d1ded7a4-e08b-453c-89a9-1689dbf5082f service nova] Acquired lock "compute-rpcapi-router" {{(pid=121223) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 04:27:54.333230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.336703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.337420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.338773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.342456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.342706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.361516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.compute.rpcapi [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 04:27:54.364247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] Releasing lock "compute-rpcapi-router" {{(pid=121223) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 04:27:54.394568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1582c11f-258b-44cd-9db0-784c09c92794 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514459 Aug 23 04:27:54.395992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 41/67] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:54.416577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:54.417576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:54.426813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:54.429228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b5d32470-43c5-42a7-afea-0641eee96d87 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.919564 Aug 23 04:27:54.444333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 27/68] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:53 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:54.447697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.449035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.450315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.452875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.453619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.455050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.483312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:54.484442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:54.508604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.510526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.512074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:54.513545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:54.515432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:54.526519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.009125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.022392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-185e3313-8c26-4c83-a33a-fc27328c1b8c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.624500 Aug 23 04:27:55.024755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 42/69] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:54 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:55.034787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:55.041438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:55.056952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.058841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.061377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.063249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.071368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.072073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.289894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.304844 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-abbaf81e-3835-4dff-ab16-58fd8db42bd4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1299 microversion: 2.1 time: 0.277666 Aug 23 04:27:55.305990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 43/70] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:55 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:55.316177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:55.316876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:55.334116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.335041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.336249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.340640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.341295 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.341882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.674120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.685795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.694585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-768aa890-6929-42f4-a00b-e4ba334ca31a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.378603 Aug 23 04:27:55.694721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.695859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 44/71] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:55 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:55.703817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:55.704690 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:55.713245 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:55.718388 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.718885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-708a63e9-4a6e-4b33-a13e-5634e6b24853 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 1.271682 Aug 23 04:27:55.719628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.720356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.721319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:55.722487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:55.723023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:55.729341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 28/72] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:54 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:56.031344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:56.039489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-329951d5-5cb9-4b99-ac45-b5f4a4bef724 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.342330 Aug 23 04:27:56.040091 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 45/73] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:55 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:56.055524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:56.056480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:56.063654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.064463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.065515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.066431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.067697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.068458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.252741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:56.261151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-52eb8f1b-6b9a-4b46-afff-f35f742db491 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.209450 Aug 23 04:27:56.261617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 29/74] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:56 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:56.348664 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:56.349286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:56.362700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.364377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.365264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.366505 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.371094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.372508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.508562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=28 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:56.591889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:56.602991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cabceb7d-e0c1-4d97-8fe1-7c129739ecfd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.259449 Aug 23 04:27:56.631146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 46/75] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:56 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:56.716774 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:56.717964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:56.729541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.731148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.733098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.735400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.736753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.738843 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.744658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:56.750723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:56.769166 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.771374 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.773583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.774492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:56.776581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:56.777685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:56.791514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:57.372351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:57.384238 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:57.389809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:57.392369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6533e5e7-d099-471e-ab33-0aebc7f0c5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.652216 Aug 23 04:27:57.402423 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:57.403948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 47/76] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:56 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:57.418468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-28f22d1b-2f9e-4d02-82ba-47af447091c3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.705597 Aug 23 04:27:57.435520 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 30/77] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:56 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:57.454099 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:57.454766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:57.485495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:57.487056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:57.488475 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:57.490605 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:57.495038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:57.495699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:57.678615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77db89a9-c264-403c-8f45-f52c6360ec03", "tag": "f1a5f116-8361-455e-9373-f0d86c41dc4f"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:57.697746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:57.702864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:57.703576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:57.727953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] Creating event network-changed:f1a5f116-8361-455e-9373-f0d86c41dc4f for instance 77db89a9-c264-403c-8f45-f52c6360ec03 on hv-cinder-85407 Aug 23 04:27:57.734622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-58149476-c8ea-4ea0-97ea-e345c2283bb6 req-d055b43a-c292-44ea-8551-b9c014f9bc0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326518 Aug 23 04:27:57.735836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 48/78] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:27:57.746220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:57.753445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:57.761103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:57.762026 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:57.762654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:57.763826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:57.764981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:57.766095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:58.136082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:58.146801 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4856fb14-3388-4f66-b5e6-2c51a0b3e295 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.709268 Aug 23 04:27:58.158958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 31/79] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:57 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:58.167890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:58.168680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:58.175582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:58.176380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:58.176995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:58.177849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:58.179408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:58.180174 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:58.431719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:58.447370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-769a53fd-f64c-4841-be83-015f03e2d96a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.710033 Aug 23 04:27:58.464306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 49/80] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:57 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:58.464306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:58.464306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:58.481540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:58.483630 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:58.486177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:58.489483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:58.491940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:58.496129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:58.999134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.008236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.009847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.011168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-01a80d08-0eea-4313-ac4d-be6158d718cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.556212 Aug 23 04:27:59.012841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 50/81] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:27:58 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:27:59.025428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:59.026273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:59.033950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.034688 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.035328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.036266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.037009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.038826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.040569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.052231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d75978a8-a433-486c-b3fa-81d6fadeedd0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.888285 Aug 23 04:27:59.053572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 32/82] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:58 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:59.170307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:59.171811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:59.179685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.183157 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.183968 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.185373 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.186891 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.187425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.233995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.245699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ad25eb1c-4933-4aa5-ab4a-4b0bd8a82e78 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.231220 Aug 23 04:27:59.246760 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 51/83] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:59 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:59.375708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.386236 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-98439fc6-d780-459a-838d-71fc8c57e883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.219697 Aug 23 04:27:59.388183 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 33/84] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:59 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:59.475945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:27:59.476529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:27:59.486494 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.487648 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.488353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.489503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.490741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.492336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.655011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:27:59.673606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f3ee33ef-9534-4d3e-af68-23a6db7a30cf tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.202394 Aug 23 04:27:59.674247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 52/85] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:27:59 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:27:59.914547 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b", "tag": "7ff1585b-e97f-4f6d-a093-a43bf254afd2"}, {"name": "network-changed", "server_uuid": "cd8238e6-e045-42e6-9bf4-b97507719b1d", "tag": "89b2c8bf-fcbd-46df-9d0d-0a4df470da86"}, {"name": "network-changed", "server_uuid": "e942f38b-c544-4991-8221-872266e4e196", "tag": "ccfb2bb6-9852-46f4-93c8-346e9d6dfb17"}, {"name": "network-changed", "server_uuid": "e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a", "tag": "ffed3c3d-2c51-45e4-bdfc-8a410e33cff3"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:27:59.937653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.938291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.938940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.969247 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Creating event network-changed:7ff1585b-e97f-4f6d-a093-a43bf254afd2 for instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b on hv-cinder-85407 Aug 23 04:27:59.970050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Creating event network-changed:89b2c8bf-fcbd-46df-9d0d-0a4df470da86 for instance cd8238e6-e045-42e6-9bf4-b97507719b1d on hv-cinder-85407 Aug 23 04:27:59.970755 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Creating event network-changed:ccfb2bb6-9852-46f4-93c8-346e9d6dfb17 for instance e942f38b-c544-4991-8221-872266e4e196 on hv-cinder-85407 Aug 23 04:27:59.971451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Creating event network-changed:ffed3c3d-2c51-45e4-bdfc-8a410e33cff3 for instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a on hv-cinder-85407 Aug 23 04:27:59.972563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121224) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 04:27:59.973151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-05dc5bb0-d5b2-49f3-a170-523f9d295607 req-dd5582f5-071a-468d-b772-d73b617db813 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121224) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 04:27:59.974438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.975094 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.975719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.976649 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:27:59.977420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:27:59.978028 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:27:59.992715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.compute.rpcapi [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 04:27:59.993637 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] Releasing lock "compute-rpcapi-router" {{(pid=121224) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 04:28:00.036359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:00.036982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:00.045321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.047854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.048598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.049580 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.051504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-777b849f-4d9e-479f-991d-8edcd6093d52 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.153323 Aug 23 04:28:00.051952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.052378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.053013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 34/86] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:00.083486 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:00.084336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:00.097816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.098783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.099708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.100654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.101130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.102054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.328528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.340925 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.351931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e34f5a0a-b251-431a-b606-3520e20e4c65 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.280740 Aug 23 04:28:00.355150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 35/87] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:00 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:00.366570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.368660 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.370428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-555b59a2-5960-4bb0-8688-88e87f3af5b4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.339654 Aug 23 04:28:00.371354 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 53/88] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:00 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:00.374288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:00.375527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:00.382364 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.382858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.383288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.384204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.384800 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.385368 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.409042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:00.409895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:00.416123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.416875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.417467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.418339 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.418975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.419559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.718929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.722317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.731996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3b2951ac-985f-459b-97a7-bb1fa0a690cc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.327059 Aug 23 04:28:00.745902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c08c0ab2-9e75-4ca0-8495-703632c01824 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.365049 Aug 23 04:28:00.745902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 36/89] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:00 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:00.745902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:00.745902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:00.747042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 54/90] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:00 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:00.753463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.754182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.754911 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.755610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:00.756090 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:00.756507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:00.953225 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:00.961362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b7ce3f5c-80ce-4bca-9703-4e5a16b7b947 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.226662 Aug 23 04:28:00.962031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 37/91] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:00 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:01.377994 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:01.378599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:01.384902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.385405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.385828 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.386483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.388968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.389592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.395499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:01.396369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:01.404293 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.404850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.405372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.406799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.407348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.408059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.691018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:01.695303 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:01.705816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:01.706073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-09178a61-ce09-4eb9-a108-8eb82ab42ded tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.332101 Aug 23 04:28:01.707539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 55/92] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:01 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:01.728007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:01.730577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5245d936-ae3f-4b22-941b-c8e578064bf2 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.340421 Aug 23 04:28:01.744934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 38/93] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:01 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:01.754432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:01.755284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:01.765176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.765951 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:01.766781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:01.769647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.770335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.771786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.772805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.773649 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.774259 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.778416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.779180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:01.780113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:01.780715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:01.783176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.033118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.042209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a4494851-0853-4ba9-a153-042057a09a65 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.281719 Aug 23 04:28:02.043229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 39/94] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:01 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:02.048707 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:02.049397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:02.056556 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.057052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.057470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.058158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.058604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.059020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.072947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.087007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-708bb59c-8b4b-4311-9952-5b375b10f4f7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.336644 Aug 23 04:28:02.087586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 56/95] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:01 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:02.213583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.222545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4898aa9d-3bdc-4b2a-a8bf-b0abcfb336ac tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.177537 Aug 23 04:28:02.223428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 40/96] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:02 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:02.730201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:02.730707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:02.737333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.738061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.738835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.739825 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.740473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.741153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.760060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:02.761760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:02.775674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.778306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.778748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.779445 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:02.779887 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:02.780332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:02.976821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.981850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.989425 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0e795a86-9f26-48d3-8a69-c6356a010efe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.263138 Aug 23 04:28:02.990374 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 57/97] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:02 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:02.994396 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:02.998802 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:03.001995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d3aaef51-3f03-445d-9030-43df576559af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.247561 Aug 23 04:28:03.003037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 41/98] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:02 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:03.063490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:03.064194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:03.070423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.071123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.071539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.072540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.073199 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.073713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.079955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:03.108414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:03.109078 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:03.119298 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.119779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.124503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.126211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.127431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.128206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.369947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:03.377457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:03.381375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-16bdd418-fad2-40a2-b211-67a2012bcb14 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.322160 Aug 23 04:28:03.382597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 58/99] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:03 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:03.387046 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-477b9c34-53b9-499a-a16c-bea0f4b1b679 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.282506 Aug 23 04:28:03.391962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 42/100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:03 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:03.392097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:03.392097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:03.399690 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.400452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.401040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.401910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:03.402355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:03.402763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:03.553673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:03.561482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-645a4c70-d0cf-46f8-acc8-02f4f6be694e tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.177893 Aug 23 04:28:03.562017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 59/101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:03 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:04.010438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:04.011182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:04.017737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.018212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.018636 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.019323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.020214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.020645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.024939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:04.025498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:04.034289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.034289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.034289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.034289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.034616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.034616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.231799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.233803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.240870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0143758e-0f9a-453a-9ba8-bc1c71d5840e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.234172 Aug 23 04:28:04.241783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 43/102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:04 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:04.244305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.245882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.247058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-03833db1-419e-43c2-ae4d-064adf105bb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.226105 Aug 23 04:28:04.247686 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 60/103] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:04 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:04.408747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:04.409408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:04.409751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:04.410154 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:04.415947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=8 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:04.417656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.418145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.418635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.419333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.419779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.420283 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.420567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.421049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.424380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.425418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.425949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.426584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.635159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.645775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.651853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b59e1f2e-e776-44a7-951d-5d2b588bec91 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.248267 Aug 23 04:28:04.654779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0ec8ed06-2666-4038-8ade-7fc9b1ad883c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.250136 Aug 23 04:28:04.655333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 61/104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:04 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:04.659949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:04.660546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:04.677110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 44/105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:04 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:04.678820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.679306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.679730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.680576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:04.681153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:04.681427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:04.813713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:04.821421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-25f45f76-423d-4ee5-bf4a-5514f5a069bb tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.165139 Aug 23 04:28:04.822174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 62/106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:04 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:05.261736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:05.262325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:05.269425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.269833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.270267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.270925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.271368 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.271783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.272584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:05.273308 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:05.280014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.280758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.281543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.283330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.283847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.284475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.498657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.507552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c5cfb813-d4f5-45ff-b545-3b4da416c850 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.249583 Aug 23 04:28:05.510092 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 45/107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:05 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:05.522559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.533450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.535289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.536584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-84123b87-d3b1-4460-89a4-8a931af9efc4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.269219 Aug 23 04:28:05.539242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 63/108] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:05 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:05.674009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:05.674653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:05.681819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.682345 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.682776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.683473 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.683985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.684413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.686204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:05.686677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:05.707772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.712274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.714935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.717375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.719982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.724936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.959721 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.961925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:05.966540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-939e0509-842c-459c-90fb-52b9e953d709 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.284652 Aug 23 04:28:05.967190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 64/109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:05 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:05.971098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-080dba07-384c-47ae-8256-7cb673d724c8 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.300932 Aug 23 04:28:05.975956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 46/110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:05 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:05.981808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:05.983245 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:05.990408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.991653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.991762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:05.994639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:05.995123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:05.995617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:06.018972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:06.044283 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "name": "network-vif-plugged", "status": "completed", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:06.054046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:06.054517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:06.054934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:06.066789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] Creating event network-vif-plugged:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:28:06.072177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-a7c2ec8b-d48f-4610-abf2-aabba871718d req-6a69bcdf-8180-4cb2-a3e5-66ee9205adc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103513 Aug 23 04:28:06.072806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 65/111] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:06.150675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:06.158446 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e6bc77e8-7ad0-4392-9376-a14e82b6cda9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.185115 Aug 23 04:28:06.159010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 47/112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:05 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:06.526184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1962413238", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "networks": [{"uuid": "5b36f391-9303-491b-a896-5de83bacd8ff"}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:06.531973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:06.533133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:06.540311 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:06.541280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:06.541896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:06.542776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:06.543427 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:06.544106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:06.584350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] validate_networks() for [('5b36f391-9303-491b-a896-5de83bacd8ff', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:28:06.766544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:06.774872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9af231e0-8f28-46fb-a71d-16b6e73fbc94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.246680 Aug 23 04:28:06.775448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 48/113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:06 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:06.792222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:06.792920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:06.799779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:06.800296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:06.800723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:06.801411 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:06.801856 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:06.802270 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.038610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.053978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.057812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.060518 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cad5d96d-d761-4e2f-b454-c97d7c99312c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.282804 Aug 23 04:28:07.062000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 49/114] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:06 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:07.078724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:07.080569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:07.091577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.092626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.093500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.094920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.097421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.098397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.343201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:28:07.343703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:28:07.344785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:28:07.345410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:28:07.345814 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:28:07.356915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.357151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.357495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.358428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.358861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.359490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.379791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Getting quotas for project 57d3d5a2a0514d7687e794f8a678cff9. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:28:07.384200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Getting quotas for user 4eb4a476712c492da2313ef426001e33 and project 57d3d5a2a0514d7687e794f8a678cff9. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:28:07.396516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:28:07.399096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:28:07.399252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.407868 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c08fa7ff-c5bb-4935-b464-ba0446caa5bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.344573 Aug 23 04:28:07.411995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 50/115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:07 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:07.414330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:07.415135 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:07.425571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.426184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.426832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.427945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.428678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.429162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.456620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f1d70d75-132f-45f2-8393-a4c30d8cc0b3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934711 Aug 23 04:28:07.457257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 66/116] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 04:28:07.469321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:07.470325 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:07.477928 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.478742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.479387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.480303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.480944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.481556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.681995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.697704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8c4ef519-a539-481c-984c-2578d0abe3fa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.287968 Aug 23 04:28:07.698308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 51/117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:07 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:07.699574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.703251 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-18e9fe72-6dc6-4a80-9b5a-4d44f3ae580a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:07.705902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-18e9fe72-6dc6-4a80-9b5a-4d44f3ae580a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:07.716158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e34e8b80-f55c-4166-8f25-c480726f076a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.250646 Aug 23 04:28:07.716968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 67/118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:07 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:07.788190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-18e9fe72-6dc6-4a80-9b5a-4d44f3ae580a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:07.796346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:07.797687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:07.804928 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.805643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.805959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-18e9fe72-6dc6-4a80-9b5a-4d44f3ae580a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1219 microversion: 2.1 time: 0.106551 Aug 23 04:28:07.806551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.807809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:07.808667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:07.809368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:07.816939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 52/119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:07 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:08.027089 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.035604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cc4da9e3-7f58-460e-ae80-98305e15ac94 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.244097 Aug 23 04:28:08.036551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 68/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:07 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:08.085810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:08.086405 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:08.092276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.092747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.093186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.094760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.095197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.095634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.237216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.248172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.251560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.253150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3042993a-3b61-4cf2-8c6c-9deaa09896f3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.171251 Aug 23 04:28:08.264165 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 53/121] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:08 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:08.431009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:08.431689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:08.438503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.439054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.439548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.440521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.440984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.441381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.595402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.603515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-13579581-552f-4e72-92bb-4f23b84d24a1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.176823 Aug 23 04:28:08.604335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 69/122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:08 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:08.718655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:08.719262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:08.725780 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.726255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.726689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.727374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.727817 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.728254 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.739239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:08.740594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:08.747881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.748692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.749965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.750979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.751687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.752414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.952118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.959941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-81d4f6ba-1722-4680-aa5f-0789fbda95d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.245194 Aug 23 04:28:08.961238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 54/123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:08 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:08.963075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:08.966615 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:08.967204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:08.975214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-26d44723-b91a-4754-9c4e-dc83593335c8 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.239838 Aug 23 04:28:08.979957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 70/124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:08 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:08.980082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.980082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.980082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:08.980082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:08.980379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:08.980379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.044104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.052551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d9d7267e-ff6b-4f28-881d-9e0d5a721d18 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1223 microversion: 2.1 time: 0.090183 Aug 23 04:28:09.056549 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:09.057301 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:09.060049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 55/125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:08 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:09.063368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.066537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.066537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.066537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.066537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.066857 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.199025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.207065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5a0386b8-9132-4b0f-bd88-ece347e3f085 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.154371 Aug 23 04:28:09.207632 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 71/126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:09 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:09.279549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:09.280173 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:09.287481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.287976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.288560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.289397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.289977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.290569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.425784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.437158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.439100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.440217 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3bf4a9a1-f75c-41cb-a741-46b1a087cd26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.164453 Aug 23 04:28:09.440744 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 56/127] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:09 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:09.624329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:09.625726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:09.631991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.632471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.632900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.633582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.634030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.634444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.771051 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:09.779109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f0fad4f1-d02c-4202-a87d-7f564df92bc1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.158775 Aug 23 04:28:09.779733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 72/128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:09 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:09.982194 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:09.982838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:09.985895 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:09.989686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.990169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.990665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.991350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:09.991791 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:09.992248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:09.996070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:09.996978 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:10.005738 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.006400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.007143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.008639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.009118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.009535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.203407 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.217886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.219538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fd6afec2-eaf8-410c-ba8d-7750adc2739b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.240964 Aug 23 04:28:10.220307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 57/129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:09 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:10.225701 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:10.226365 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:10.232537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.233010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.233492 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.234299 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.234903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.235275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.242578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7ed03c5a-c555-4cda-b342-33539ee44b22 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.248595 Aug 23 04:28:10.243568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 73/130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:09 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:10.266894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:10.268258 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:10.276262 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.276847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.277365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.278269 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.279402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.280052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.371554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.380343 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fdb55aa6-2e0c-49b2-9e8b-eb8a9ac2cfb6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1223 microversion: 2.1 time: 0.158823 Aug 23 04:28:10.389122 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 58/131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:10 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:10.465901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:10.466768 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:10.476981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.480645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.481379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.483665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.484165 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.484708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.626559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.640460 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fd03a85c-1f8d-428f-8844-4b8134949568 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.383127 Aug 23 04:28:10.641059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 74/132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:10 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:10.718634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.728386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.730570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.732008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-329be44b-a251-4fef-b5c8-08b87afb2353 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.272666 Aug 23 04:28:10.748534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 59/133] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:10 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:10.799622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:10.800420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:10.806806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.807540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.808247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.809115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.809741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.810209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.873404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b", "name": "network-vif-plugged", "status": "completed", "tag": "7ff1585b-e97f-4f6d-a093-a43bf254afd2"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:10.885275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:10.885962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:10.886614 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:10.902734 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] Creating event network-vif-plugged:7ff1585b-e97f-4f6d-a093-a43bf254afd2 for instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b on hv-cinder-85407 Aug 23 04:28:10.908551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-09fd84e0-5f6f-42ca-8cf9-4e0936524bf9 req-e8e1572d-6720-4d2c-996f-4f846a23efe4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Aug 23 04:28:10.909443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 60/134] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:28:10.980772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:10.988495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4cf80cf7-609b-47c7-b22b-1e92d440a4c2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.193817 Aug 23 04:28:10.989054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 75/135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:10 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:11.243418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:11.244146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:11.250924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.251401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.251830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.252544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.252983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.253402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.266270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:11.267085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:11.274024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.274499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.275096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.275870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.276336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.276741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.282082 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:11.500457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:11.509342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1d9c722e-dad0-4d12-b515-9903add1b56c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.269686 Aug 23 04:28:11.510364 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 61/136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:11 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:11.515836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:11.516691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:11.520219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:11.528908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-14f5a50d-8687-4a18-ab97-ecb9fb278404 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.266710 Aug 23 04:28:11.531497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.532210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.532847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.533738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.534392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.535002 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.540291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 76/137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:11 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:11.603824 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:11.612259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-17e7da9f-329d-4666-ab2e-630a6ac754ee tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1215 microversion: 2.1 time: 0.100712 Aug 23 04:28:11.612828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 62/138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:11 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:11.662702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:11.663309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:11.669766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.670237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.670654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.671330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.671763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.672209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.756253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:11.756839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:11.765017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.765572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.766300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.767191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:11.768179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:11.768814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:11.915798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:11.927579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e2ddaa8d-c632-4f5f-9a9e-295560baf0c8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.269172 Aug 23 04:28:11.928220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 77/139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:11 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:12.012434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:12.013080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:12.019852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.020523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.020647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.021570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.022542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.023516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.024841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.034465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.036708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.038047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2c863c8f-d0bc-4e89-8984-8e0a96e9ec6b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.286085 Aug 23 04:28:12.038947 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 63/140] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:11 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:12.188982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.198554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1827d5c2-11a5-4c82-8a04-58d19ab2287a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.193400 Aug 23 04:28:12.212851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 78/141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:12 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:12.530514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:12.531142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:12.537438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.538141 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.538732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.539403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.540127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.540360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.549615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:12.550219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:12.553152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:12.557592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.558066 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.558481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.559362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.559805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.560243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.751108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.757720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.765480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3e272fdc-dce7-429c-8e0d-289dfbf61788 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.238712 Aug 23 04:28:12.766026 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 64/142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:12 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:12.770433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:12.771001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:12.775561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f5b80c18-ac54-49b6-a00f-5b221beb5e6f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.229703 Aug 23 04:28:12.776550 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 79/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:12 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:12.780331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.781448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.781842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.782662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.783164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.783554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.846512 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:12.850284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:12.858330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dec35621-1ef4-47e9-863e-084b930a4ebc tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1271 microversion: 2.1 time: 0.091306 Aug 23 04:28:12.858931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 65/144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:12 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:12.927363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77db89a9-c264-403c-8f45-f52c6360ec03", "name": "network-vif-plugged", "status": "completed", "tag": "f1a5f116-8361-455e-9373-f0d86c41dc4f"}, {"server_uuid": "cd8238e6-e045-42e6-9bf4-b97507719b1d", "name": "network-vif-plugged", "status": "completed", "tag": "89b2c8bf-fcbd-46df-9d0d-0a4df470da86"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:12.938139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.938603 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.939016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.952261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Creating event network-vif-plugged:f1a5f116-8361-455e-9373-f0d86c41dc4f for instance 77db89a9-c264-403c-8f45-f52c6360ec03 on hv-cinder-85407 Aug 23 04:28:12.952874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] Creating event network-vif-plugged:89b2c8bf-fcbd-46df-9d0d-0a4df470da86 for instance cd8238e6-e045-42e6-9bf4-b97507719b1d on hv-cinder-85407 Aug 23 04:28:12.957277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:12.957967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:12.959472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-68ead51a-6ecf-4004-ac2c-13b75479777d req-8d15ba70-4616-4a3d-a1af-22f4f8cf296f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035996 Aug 23 04:28:12.960334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 80/145] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:12.964158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.964657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.965119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:12.965685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:12.966117 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:12.966521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.063876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:13.064659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:13.072212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.072781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.073489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.074277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.074749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.075265 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.104439 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:13.113632 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1cc48b56-4720-4f10-bdb3-69bf652a2310 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.160670 Aug 23 04:28:13.114853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 66/146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:12 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:13.220384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:13.223665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:13.224479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:13.229607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:13.231322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:13.231721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.232248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.232821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.232973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cc56aa7d-e314-412d-b906-20d8a64dfbd4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.173755 Aug 23 04:28:13.233778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 81/147] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:13 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:13.248160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.248758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.249193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.389053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:13.397073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-594f8f63-c0d7-4d94-bb95-456903a1c893 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.178544 Aug 23 04:28:13.397864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 67/148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:13 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:13.789830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:13.790761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:13.799661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:13.800561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.800758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:13.801327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.801970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.803001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.803682 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.804307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.809761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.810452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.811159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:13.812503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:13.813105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:13.813679 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.010654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.013295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.018698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-195d66ef-f173-4dfe-95b8-d711ef3c4a4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.234740 Aug 23 04:28:14.019247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 82/149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:13 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:14.021599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fa60827d-8170-43e1-91d1-02f7a13c66f1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.228124 Aug 23 04:28:14.022274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 68/150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:13 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:14.024080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:14.024684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:14.030673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.031298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.031820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.032594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.033133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.033554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.094843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.103365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-78a5080a-56ff-4133-a087-ef603642ff3a tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1271 microversion: 2.1 time: 0.083121 Aug 23 04:28:14.103964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 83/151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:14 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:14.134687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:14.135291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:14.141665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.142138 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.142570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.143276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.143727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.144169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.256832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:14.257489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:14.263793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.264300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.264720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.265515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.266237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.266652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.290707 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.298585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2ce187b0-975a-41e8-acee-7a166846a34c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.167766 Aug 23 04:28:14.299282 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 69/152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:14 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:14.408227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.418313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.418491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:14.419113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:14.419791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.420929 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d8c284b4-2e78-4c12-b24e-ede01bd51c20 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.168050 Aug 23 04:28:14.422081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 84/153] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:14 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:14.425701 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.426251 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.426738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.427500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:14.427972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:14.428504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:14.563356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:14.571384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1fe4f09d-2bfd-45ae-be23-c8d0559376a3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.156795 Aug 23 04:28:14.571953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 70/154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:14 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:15.039078 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.039698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.042440 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.043037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.046329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.047120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.047535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.048433 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.048881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.049219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.049383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.049693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.050094 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.050771 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.051208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.051650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.255344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.257061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.266446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2cd646ae-3e6a-4acb-9469-c83a14e1ff88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.231171 Aug 23 04:28:15.266568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-baa19cf1-c01c-4c06-8ef4-ceab064b9853 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.227194 Aug 23 04:28:15.269322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 71/155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:15.275317 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.276802 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.280651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 85/156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:15.283603 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.284128 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.284548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.285221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.285655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.286060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.318785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.319304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.325661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.326373 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.327007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.328459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.328459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.329019 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.348370 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.356242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7033b420-d829-45a3-adc3-5254d3374ce1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1271 microversion: 2.1 time: 0.085563 Aug 23 04:28:15.356802 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 72/157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:15.442816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.443418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.445284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:15.450511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.450985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.451395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.452110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.452549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.453202 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.465680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.475057 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-556c7582-1cb6-4ee8-8198-54e0db3dc8e6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.160006 Aug 23 04:28:15.475858 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 86/158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:15.599201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:15.600240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:15.606308 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.606795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.607229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.608012 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:15.608364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:15.608775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:15.611255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.620038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.621731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.623271 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-feeab9e4-f5ed-4fae-ab43-17718a7cbb23 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1407 microversion: 2.20 time: 0.184150 Aug 23 04:28:15.623745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 73/159] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:28:15.872529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:15.881818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-be66a424-8b20-47a5-aff0-ff9b462c9a99 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.286797 Aug 23 04:28:15.883952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 87/160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:15 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:16.287832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.288596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.290662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.291746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.294875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.295356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.295775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.296478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.297094 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.297484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.298115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.299019 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.299448 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.300173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.300647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.301061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.491463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.493449 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.499331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f2dca626-8d71-4db3-aece-4ed7d522011f tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.215574 Aug 23 04:28:16.499998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 74/161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:16.501656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-26bf73eb-47be-46d5-b5d2-2c5e5c0835db tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.214953 Aug 23 04:28:16.503438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 88/162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:16.505025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.505677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.508428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.509239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.511655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.512216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.512700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.513480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.513955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.514426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.516960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.517437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.517866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.518692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.519139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.519588 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.583845 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.591592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1e7f45fa-24c9-486f-ac21-ebdb62f209ae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1271 microversion: 2.1 time: 0.090527 Aug 23 04:28:16.592226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 75/163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:16.645861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.646555 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.652622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.653025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.653420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.654095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.654528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.654930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.670610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.678948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f1073203-adc3-4711-8cb4-a01c40b6a483 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.175650 Aug 23 04:28:16.679496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 89/164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:16.793305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.805954 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.808378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:16.810159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8980fe4d-907b-43ef-a4b4-43d1d645b4d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1600 microversion: 2.20 time: 0.168183 Aug 23 04:28:16.810993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 76/165] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:28:16.834180 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.834652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.840981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.841449 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.841864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.842564 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.842992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.843395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.902591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:16.903257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:16.910741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.911302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.911829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.912618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:16.913126 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:16.913652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:16.967883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3b868926-f46f-4c09-9c33-2e66a0c145fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137746 Aug 23 04:28:16.975819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 90/166] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:28:17.068632 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:17.076557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e48d19c9-e7c2-436d-869e-b791b82ad5d9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.177775 Aug 23 04:28:17.077428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 77/167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:16 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:17.518406 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:17.519171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=6 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:17.523771 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:17.524254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:17.524438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:17.524557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:17.530342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.530824 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.531266 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.531364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.531998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.532277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.532451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.532815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.533147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.533259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.533591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.534002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.737697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:17.741281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:17.746106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b3badb0c-4706-4be8-82fe-efc7bf59afbc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.227844 Aug 23 04:28:17.747043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 78/168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:17 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:17.749604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9e08fc16-0670-47ad-b0aa-e52a79852aee tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.232096 Aug 23 04:28:17.762751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:17.762751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:17.762751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.762751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.764190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.764190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.764190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.764190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.765285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 91/169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:17 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:17.771635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:17.772534 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:17.780070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.780547 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.781135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.782099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:17.782728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:17.783141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:17.805813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:17.841316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:17.850062 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5072a701-33a6-4b82-a6e3-b82216ee91b4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1271 microversion: 2.1 time: 0.101946 Aug 23 04:28:17.851312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 79/170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:17 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:17.943141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:17.952882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-151eab2e-8723-400f-a330-831e3cdc15e5 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.186238 Aug 23 04:28:17.953620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 92/171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:17 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:18.011991 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e942f38b-c544-4991-8221-872266e4e196", "name": "network-vif-plugged", "status": "completed", "tag": "ccfb2bb6-9852-46f4-93c8-346e9d6dfb17"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:18.025252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.025721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.026298 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.039072 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] Creating event network-vif-plugged:ccfb2bb6-9852-46f4-93c8-346e9d6dfb17 for instance e942f38b-c544-4991-8221-872266e4e196 on hv-cinder-85407 Aug 23 04:28:18.044545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-d396cf75-5f33-4894-ae7a-77074042c0d4 req-4a43ce3c-4360-4e7c-9e19-9fe3b89fe10f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039709 Aug 23 04:28:18.045633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 80/172] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:18.097740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:18.098359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:18.104236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.104707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.105129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.105808 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.106245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.106649 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.235357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:18.238795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:18.243883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d4f83f38-cfe1-4b2f-af49-9393750536a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.150448 Aug 23 04:28:18.244463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 93/173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:18 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:18.371967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:18.381662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.382126 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.382535 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.393409 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] Creating event network-changed:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:28:18.398103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-3dba4402-fda6-401b-b492-8b6ea5bc0caa req-5826b6bf-c21e-45c1-a80c-a781012d9394 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030021 Aug 23 04:28:18.398721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 81/174] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:28:18.769314 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:18.769918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:18.772910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:18.774182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:18.784079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.784859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.785459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.786050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.786538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.786729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.786962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.787522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.787624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:18.788268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:18.788370 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:18.788763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.608358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:19.618727 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1cad46dd-fb27-427c-aa1a-e739b769a614 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.854662 Aug 23 04:28:19.620238 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 94/175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:18 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:19.627059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:19.627849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:19.634758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.635471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.635898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.636950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.637117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.637535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.665305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:19.676730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f15d6e72-e931-4e34-b5ac-a2bc5b4e8e8a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.910005 Aug 23 04:28:19.677645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 82/176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:18 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:19.684726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:19.685336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:19.699854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.712609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.713068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.713818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.714304 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.714686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.756783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:19.765753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a957ab2d-4548-4da0-8474-146e1294e876 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1277 microversion: 2.1 time: 0.144340 Aug 23 04:28:19.766697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 95/177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:19 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:19.773484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:19.775326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:19.783385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.783883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.784343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.785039 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:19.785643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:19.786065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:19.969699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:19.974695 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:19.980651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f745825c-4be3-4c2b-9148-6a33976c7dc9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.301808 Aug 23 04:28:19.981576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 83/178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:19 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:20.055271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:20.064398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-40f7c71c-7fec-4efd-9b21-b2b25c57e1f4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.295039 Aug 23 04:28:20.064903 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 96/179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:19 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:20.639693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:20.640567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:20.646672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.647143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.647566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.648276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.648718 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.649133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.696855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:20.697455 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:20.703485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.704126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.704493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.705176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.705734 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.706157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.843300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:20.851793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c92cab3b-5395-461a-8feb-ff06764fec7f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.216231 Aug 23 04:28:20.852401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 84/180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:20 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:20.856769 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:20.857355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:20.863778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.864321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.864731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.865426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:20.865877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:20.866288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:20.878544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:20.886332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-62a75990-7ed8-49ce-b544-8e56d0dfd4fd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.193268 Aug 23 04:28:20.886863 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 97/181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:20 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:21.001394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:21.001888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:21.002163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:21.008631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.009114 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.009485 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2621837d-03e9-40ac-8c76-f843e89c7157 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.156066 Aug 23 04:28:21.009644 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.010195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 85/182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:20 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:21.010384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.010703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.011146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.085292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:21.086010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:21.091932 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.092622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.092810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.093560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.093925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.094347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.174008 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:21.181660 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-79ab8e21-07c3-4f4d-8723-433afdea4df9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.183973 Aug 23 04:28:21.182263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 98/183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:20 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:21.241562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:21.249577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-14fe91da-7b69-4356-a4ef-e962f2ae50ba tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.168109 Aug 23 04:28:21.250098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 86/184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:21 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:21.874940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:21.876064 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:21.884592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.885328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.885754 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.886652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.887231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.887775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.906888 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:21.907610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:21.914017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.914481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.914922 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:21.915581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:21.916052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:21.916436 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.094588 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:22.102988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6bd6b1ab-d869-4bd9-bdf7-7caad472b33d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.233180 Aug 23 04:28:22.103519 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 99/185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:21 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:22.107938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:22.108556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:22.111413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:22.115092 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.116482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.116894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.117567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.118010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.118413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.119431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3741bd23-637d-4e8f-8c9c-c65317e2591c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.216422 Aug 23 04:28:22.120032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 87/186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:21 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:22.201567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:22.202244 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:22.208586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.209138 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.209626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.210338 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.210857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.211262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.259208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:22.266979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6ae8c8a4-fefc-4b38-b073-ae126d8c0993 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.162358 Aug 23 04:28:22.267435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 100/187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:22 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:22.275975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:22.276723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:22.283793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.284553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.285330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.286116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.286796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.287430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.376424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:22.384640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-78ca0ea1-76fe-44ab-9839-20ef0e331200 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.186969 Aug 23 04:28:22.399835 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 88/188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:22 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:22.439390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:22.447117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-70098c3c-4ec5-4272-a88f-2d0dff3000c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.175176 Aug 23 04:28:22.447679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 101/189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:22 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:22.889606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a", "name": "network-vif-plugged", "status": "completed", "tag": "ffed3c3d-2c51-45e4-bdfc-8a410e33cff3"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:22.901073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:22.901583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:22.901983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:22.914438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] Creating event network-vif-plugged:ffed3c3d-2c51-45e4-bdfc-8a410e33cff3 for instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a on hv-cinder-85407 Aug 23 04:28:22.919493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-3ada9828-4f80-47e6-8acb-bc2964f1729e req-4ea648a0-b2ee-4d86-881c-249bb4020868 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Aug 23 04:28:22.920195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 89/190] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:23.122737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:23.123353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:23.130167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.130578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.130999 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.131676 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.132146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.132554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.143422 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:23.144896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:23.153212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.153709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.154391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.155557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.156258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.156708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.393083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:23.401049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d5b02502-8ae6-4097-aa15-0f57baeafbaa tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1362 microversion: 2.1 time: 0.282095 Aug 23 04:28:23.401599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 102/191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:23 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:23.406498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:23.408235 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:23.414892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.415345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.415769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.416490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.416931 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.417345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.441963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:23.450681 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e13b006e-f734-497b-b307-c9737148f4d0 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1315 microversion: 2.1 time: 0.313829 Aug 23 04:28:23.451274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 90/192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:23 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:23.456280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:23.457104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:23.463306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.464113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.464721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.465835 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.466470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.466886 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.697536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:23.706466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c77486e3-1350-4621-867c-ee5459670aff tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.303751 Aug 23 04:28:23.707040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 103/193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:23 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:23.720033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:23.720033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:23.723348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:23.725480 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.725999 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.726426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.727085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.727737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.728473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.732051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c934b557-5dbc-476d-bd08-b6f27d62632b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.279374 Aug 23 04:28:23.732694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 91/194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:23 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:23.939037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:23.956731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-001bb877-d29f-462e-ac57-e0316ae7a983 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.241216 Aug 23 04:28:23.956731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 104/195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:23 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:23.972831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8862871b-f595-4169-8c06-96a893427670", "tag": "536b7c5c-b80f-4902-b8ed-4f957b02ca82"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:23.982703 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:23.983177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:23.983599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:23.994804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] Creating event network-changed:536b7c5c-b80f-4902-b8ed-4f957b02ca82 for instance 8862871b-f595-4169-8c06-96a893427670 on hv-cinder-85407 Aug 23 04:28:24.000132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-8a696eb9-b480-4a4d-a69e-e79a45e85442 req-f09545d7-6b8e-4d2d-ab81-6d277bd7a264 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031418 Aug 23 04:28:24.000934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 92/196] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:24.422323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:24.423640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:24.430383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.430861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.431285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.431990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.432434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.432848 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.471276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:24.472897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:24.479316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.479846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.480291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.480984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.481453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.481872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.621239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:24.629512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6664510f-2ca8-4c19-b395-d3dbe4a33e05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1549 microversion: 2.1 time: 0.211093 Aug 23 04:28:24.630045 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 105/197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:24 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:24.649386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:24.650409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:24.650880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:24.657124 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.657551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-037bc5a0-fe65-4ad8-8212-741dcbc391ca tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1502 microversion: 2.1 time: 0.190570 Aug 23 04:28:24.657778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.657953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.658080 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 93/198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:24 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:24.658654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.659058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.659645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.730622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:24.731206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:24.738056 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f2757ee6-cebe-4bdd-a91a-86ec1849245d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091408 Aug 23 04:28:24.738645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 106/199] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:28:24 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:24.740834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.741333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.741779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.742487 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.743079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.743500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.753345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:24.754131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:24.772154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.772640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.773074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:24.783669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:24.784223 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:24.784661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:25.155949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:25.167953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:25.179948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-88da1823-7ee3-4dea-b9eb-18886d3c19e2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.452031 Aug 23 04:28:25.186474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-76aa6a87-3637-437e-b92b-60c816705f63 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.437151 Aug 23 04:28:25.187689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 107/200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:24 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:25.192910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 94/201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:24 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:25.194332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:25.195154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:25.209121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:25.209601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:25.210025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:25.210716 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:25.211156 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:25.211710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:25.840958 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:25.853151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-911c7628-e9d5-492d-8fc0-0ac3d19cabf7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1322 microversion: 2.1 time: 0.663366 Aug 23 04:28:25.855811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 108/202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:25 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:26.087033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eec79fda-6be2-4703-bb39-4e9b45489fb9"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:26.090996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:26.099197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.099676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.100136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.100818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.101275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.101847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.204590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:26.206086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:26.213212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.214132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.214801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.215735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.218827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.219607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.466539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:26.477197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d087a40c-5d99-42dc-b895-494a840930d4 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.277104 Aug 23 04:28:26.478030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 109/203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:26 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:26.482795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:26.483400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:26.489378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.490040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.490631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.491314 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.491903 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.492517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.692141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:26.696252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:26.702610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fa190032-3d65-47d7-b38e-b98a3948301a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.223433 Aug 23 04:28:26.720687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 110/204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:26 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:26.868309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b", "tag": "7ff1585b-e97f-4f6d-a093-a43bf254afd2"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:26.880427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.881102 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.881694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.894486 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] Creating event network-changed:7ff1585b-e97f-4f6d-a093-a43bf254afd2 for instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b on hv-cinder-85407 Aug 23 04:28:26.899629 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-a9cc5025-7ad8-41fe-9540-ccdd450854ca req-0f0d6414-8cfd-4777-8213-ea42500fa03d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034885 Aug 23 04:28:26.900256 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 111/205] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:28:26.905548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:26.906215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:26.913337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.913977 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.914601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:26.915559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:26.916023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:26.916434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:27.232873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:27.241811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-91708988-8535-405b-a895-487f8c97f57a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1515 microversion: 2.1 time: 0.340425 Aug 23 04:28:27.242377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 112/206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:26 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:27.262655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:27.264878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:27.271059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:27.271526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:27.272145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:27.272826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:27.273262 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:27.273670 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:27.296680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'flavor' on Instance uuid e942f38b-c544-4991-8221-872266e4e196 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:28:27.414649 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-845ac9d7-82a1-42a4-be29-8de33a378191 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196/action" status: 200 len: 32 microversion: 2.1 time: 0.155878 Aug 23 04:28:27.419473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 113/207] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:28:27 2022] POST /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 04:28:27.425515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:27.426199 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:27.432336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:27.432808 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:27.433229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:27.434124 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:27.434349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:27.434756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:28.011475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:28.027930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-60c978e4-c497-4b56-9e24-56d92c74dd80 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.606738 Aug 23 04:28:28.029628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 114/208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:27 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:28.037514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:28.038587 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:28.047285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:28.048129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:28.048951 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:28.050484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:28.051470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:28.052173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:28.238578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:28.246220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e31ddfe5-0693-4ab9-98cc-4c8454fb4bd9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.214637 Aug 23 04:28:28.246775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 115/209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:28 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:28.265225 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:28.265999 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:28.273362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:28.273896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:28.274382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:28.275155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:28.275655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:28.276102 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:28.472405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:28.491134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d1b6d60b-74b1-4001-917e-fd5cfb834bad tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.229529 Aug 23 04:28:28.495194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 116/210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:28 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:28.639757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f3a4a728-dd58-4ca1-ba60-6462f283563a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "POST /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.556679 Aug 23 04:28:28.641187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 95/211] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:28:26 2022] POST /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03/os-volume_attachments => generated 194 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:29.053708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:29.054313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:29.060307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.061030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.061665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.062667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.063341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.064068 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.225004 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:29.240044 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-34bab019-526c-4c45-8b18-2fc77c6635ff tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.189989 Aug 23 04:28:29.252378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 117/212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:29 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:29.268269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:29.270821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:29.280493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.282063 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.282885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.283830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.284782 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.285410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.512229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:29.514667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:29.515301 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:29.522834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.523417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.523569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c04e7a25-4550-40d8-a89e-7488d7e2ff38 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.260110 Aug 23 04:28:29.524184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.525116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:29.525748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 96/213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:29 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:29.525889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:29.526197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:29.816906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:29.839048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-8a83a6a1-1aab-462a-a7df-9813ed80a9c3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1363 microversion: 2.1 time: 0.327966 Aug 23 04:28:29.840048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 118/214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:29 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:30.261159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:30.261931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:30.268764 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.269243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.269669 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:30.270386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.270830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.271274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:30.540894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:30.546610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:30.548038 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:30.556656 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c867dbac-3282-4c8f-ac0d-b502fc7dcf8e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.299285 Aug 23 04:28:30.558437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 97/215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:30 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:30.576715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.577215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.577699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:30.578586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.579228 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.580010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:30.752894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:30.760756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a0a5d163-d093-46f3-b1fe-d65428f89911 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.217981 Aug 23 04:28:30.761528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 119/216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:30 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:30.862318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:30.863378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:30.882130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.884633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.905827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:30.908811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:30.910970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:30.914456 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.192225 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:31.200043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-21eae13e-386c-4e82-b6b1-908d75078402 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1553 microversion: 2.1 time: 0.343149 Aug 23 04:28:31.200616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 98/217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:30 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:31.220929 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:31.221441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:31.228161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.228836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.229317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.230018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.230456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.230860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.308514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d05f0f1a-4d17-4233-9c44-2a621d628b3f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091535 Aug 23 04:28:31.309126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 120/218] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:28:31 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:31.578300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:31.579817 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:31.585726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.586821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.587454 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.588200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.588617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.589184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.783796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:31.785252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:31.791440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.792120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.792759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.793637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:31.794273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:31.794879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:31.872382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:31.880947 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6776e0ac-0b6a-456a-bd48-70322c660d03 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.306642 Aug 23 04:28:31.881689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 99/219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:31 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:32.265226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:32.274364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-beda2ef3-be10-4918-a44e-65e9ad5a515e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.495332 Aug 23 04:28:32.274920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 121/220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:31 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:32.623419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a", "tag": "ffed3c3d-2c51-45e4-bdfc-8a410e33cff3"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:32.633235 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:32.633704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:32.634132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:32.645475 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] Creating event network-changed:ffed3c3d-2c51-45e4-bdfc-8a410e33cff3 for instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a on hv-cinder-85407 Aug 23 04:28:32.650563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-1ba32c91-0d8d-42c8-b839-0846c6bbedcb req-1c48c3f5-6ea5-4ec6-aaa5-1b7a8d77bea8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030902 Aug 23 04:28:32.651141 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 100/221] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:32.902198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:32.902769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:32.909235 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:32.909709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:32.910127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:32.910801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:32.911239 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:32.911646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:33.047150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:33.056680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4880c372-261a-4856-9f53-ba129df94a27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.158644 Aug 23 04:28:33.057628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 122/222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:32 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:33.295963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:33.296599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:33.302983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:33.303453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:33.303872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:33.304578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:33.304988 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:33.305426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:33.309542 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:33.441084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:33.449004 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-df1f696d-f871-4f5f-8090-60233b1223a6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.157810 Aug 23 04:28:33.449572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 101/223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:33 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:34.082637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:34.083633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:34.093717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:34.094658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:34.095123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:34.095812 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:34.096368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:34.096781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:34.227830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:34.238337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1b8d2fd5-32e3-43ef-9e93-311879761af8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.162210 Aug 23 04:28:34.238910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 123/224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:34 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:34.469413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:34.470014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:34.477224 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:34.477687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:34.478129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:34.478803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:34.479242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:34.479650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:34.624538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:34.633581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0821f085-8e0f-4beb-a0dc-8ed9d607b1e3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.168052 Aug 23 04:28:34.634155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 102/225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:34 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:35.258493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:35.259692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:35.267079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:35.267963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:35.268696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:35.269584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:35.270216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:35.270821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:35.533692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:35.542262 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-15e2337a-3026-4d09-9e45-8fac6db2d73e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.287515 Aug 23 04:28:35.542942 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 124/226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:35 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:35.654856 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:35.655644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:35.662956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:35.663682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:35.664167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:35.664863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:35.665307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:35.665722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:35.877685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:35.890043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-547ab6e5-52f5-45a6-80e0-dbe4db69b5fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.238805 Aug 23 04:28:35.890876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 103/227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:35 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:36.562585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:36.563236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:36.569412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:36.569873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:36.570328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:36.570999 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:36.571433 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:36.571837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:36.705318 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:36.713622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0312e8a7-d691-4dde-aa34-60cd610b97b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.154918 Aug 23 04:28:36.714198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 125/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:36 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:36.913091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:36.913709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:36.922609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:36.923076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:36.923494 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:36.924200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:36.924655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:36.925044 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:37.062803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:37.071261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5307861f-be5a-4b0c-a398-0526b661aff3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.164325 Aug 23 04:28:37.071828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 104/229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:36 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:37.735882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:37.740818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:37.744913 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:37.745365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:37.745979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:37.746905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:37.747614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:37.748508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:37.792601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:38.094571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:38.095106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:38.096976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:38.107012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.107874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cf50cace-81bb-4f77-b044-9b0b1ca5ce4c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.376813 Aug 23 04:28:38.108360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.108847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 126/230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:37 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:38.109392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.110580 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.111018 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.111441 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.398054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:38.412442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-eb2da4c4-a785-4a28-a3a1-8dce216398d6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.321782 Aug 23 04:28:38.429281 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 105/231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:38 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:38.532474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:38.533148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:38.540879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.541584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.561740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.562515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.564359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.565559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.592913 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:28:38.667454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:38.681136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d46decec-1cf0-43b2-942e-8b785b05eddd tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 204 len: 0 microversion: 2.1 time: 0.153245 Aug 23 04:28:38.681810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 127/232] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:28:38 2022] DELETE /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:28:38.691038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:38.691789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:38.698500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.699243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.699686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.700439 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.701006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.701448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.849903 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8862871b-f595-4169-8c06-96a893427670", "name": "network-vif-plugged", "status": "completed", "tag": "536b7c5c-b80f-4902-b8ed-4f957b02ca82"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:38.861263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:38.861990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:38.862200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:38.871812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:38.873925 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] Creating event network-vif-plugged:536b7c5c-b80f-4902-b8ed-4f957b02ca82 for instance 8862871b-f595-4169-8c06-96a893427670 on hv-cinder-85407 Aug 23 04:28:38.878752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-b945ae4b-3140-4134-aa9f-97ccf949312c req-58d43742-5dd2-4909-a833-20230e990695 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Aug 23 04:28:38.879652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 128/233] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:28:38.884010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-32377210-c8a4-4a3a-9a9d-b0395153d97a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1554 microversion: 2.1 time: 0.197874 Aug 23 04:28:38.884925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 106/234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:38 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:39.129507 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:39.130178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:39.136673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.137138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.137559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:39.138232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.138636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.139229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:39.280755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:39.289160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5ae42da9-1444-446e-a7e3-8b4c44a86fa6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.163920 Aug 23 04:28:39.289737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 129/235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:39 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:39.445657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:39.446263 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:39.452802 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.453277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.453720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:39.455143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.455587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.456026 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:39.588347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:39.597714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2ccaf0e9-9095-4183-a054-7736e2197f1b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.155978 Aug 23 04:28:39.598452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 107/236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:39 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:39.905420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:39.906013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:39.912600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.913062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.913483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:39.914142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:39.914673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:39.915090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:40.049356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:40.057530 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-72d2f518-7261-4e1c-9942-70d7891a1acc tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1554 microversion: 2.1 time: 0.156133 Aug 23 04:28:40.058104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 130/237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:39 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:40.308880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:40.309465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:40.315489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:40.316042 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:40.316456 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:40.317132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:40.317581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:40.317995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:40.457048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:40.466496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-886295ab-1a0c-404d-9a9d-5ceec743eddf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.161413 Aug 23 04:28:40.467162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 108/238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:40 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:40.618311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:40.618884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:40.625955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:40.626590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:40.627112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:40.628140 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:40.628678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:40.629711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:40.770100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:40.782837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3df9ccba-d807-4d20-93e7-1325ed6deb93 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.168189 Aug 23 04:28:40.783403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 131/239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:40 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:41.079684 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:41.080235 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:41.086377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.086862 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.087280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.087981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.088428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.088838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.224206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:41.232605 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2967bc88-20d4-4127-a38e-81a4f2709970 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1554 microversion: 2.1 time: 0.157238 Aug 23 04:28:41.233156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 109/240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:41 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:41.491874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:41.492617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:41.498884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.499557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.500006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.500911 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.501342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.501831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.655009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:41.662874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9c8638f2-4126-4e1d-8f6c-0daf563b784b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.174999 Aug 23 04:28:41.663440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 132/241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:41 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:41.803825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:41.804467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:41.811942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.812430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.812874 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.813648 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:41.814098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:41.814513 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:41.956612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:41.964698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bd7487f2-a534-4c8c-a50b-dd9a342886fa tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1319 microversion: 2.1 time: 0.164747 Aug 23 04:28:41.965466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 110/242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:41 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:42.255169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:42.256126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:42.262896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.263449 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.264131 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:42.264886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.265395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.266062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:42.683640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:42.684725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:42.693448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.693958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.695187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:42.695880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.696392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.696808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:42.733656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:42.742722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-23b53c9f-38dd-424a-877c-8841d63990c1 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1554 microversion: 2.1 time: 0.492001 Aug 23 04:28:42.744895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 133/243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:42 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1554 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:42.887881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:42.899013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-39544d07-5a58-4d1b-8aa9-cd53941116bc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.219211 Aug 23 04:28:42.912698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 111/244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:42 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:42.986983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:42.987745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:42.994013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.994626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.995299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:42.996174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:42.996783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:42.997298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:43.016765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77db89a9-c264-403c-8f45-f52c6360ec03", "name": "network-vif-deleted", "tag": "f1a5f116-8361-455e-9373-f0d86c41dc4f"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:43.032854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:43.033723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:43.034369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:43.047182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] Creating event network-vif-deleted:f1a5f116-8361-455e-9373-f0d86c41dc4f for instance 77db89a9-c264-403c-8f45-f52c6360ec03 on hv-cinder-85407 Aug 23 04:28:43.056064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-6424b22c-1389-4930-b22f-39b976057b16 req-1381974b-baf9-46f6-8ca9-1f8c5a29ee43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042888 Aug 23 04:28:43.058662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 112/245] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:43.159605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:43.167603 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b6cb8b70-b79a-4519-a14f-0c3e38c31b76 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1508 microversion: 2.1 time: 0.184901 Aug 23 04:28:43.168469 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 134/246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:42 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:43.765073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:43.765659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:43.772163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:43.772631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:43.773052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:43.773716 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:43.774158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:43.774562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:43.837165 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdb895190e45ba96e71fd348c41c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3169d3b318421fab1d473a51637437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:43.846308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6b18efee-37b3-47f7-afc5-b85390f8526a tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 200 len: 1346 microversion: 2.1 time: 0.085658 Aug 23 04:28:43.846907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 113/247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:43 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:43.922188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:43.923127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:43.929236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:43.929706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:43.930129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:43.930815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:43.931248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:43.931653 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:44.073120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:44.081178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e53949b2-b848-415c-b33b-ae55e4409292 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.163716 Aug 23 04:28:44.081859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 135/248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:43 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:44.760321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-818445925", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:44.814200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] validate_networks() for None {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:28:44.866825 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:44.867537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:44.874266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:44.874756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:44.875188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:44.876535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:44.876989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:44.877413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:44.892603 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] HTTP exception thrown: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Request method failure captured: Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 HTTP/1.1 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc05MKTo3xVT8mGkg_Tl6qQgYkDNTrLWUogRLX-1l42gVAIxzyCx4HGKPVWFNTTDznW9KXO8qva7OUduICSRAWvOyIWNAhsCQUSsa9Go4fAmSqBcvyS3l8z21lKSuGowpzUt_4r8wzP8WOex_Xa01-M1YZ4DPbrhM6NurAL19LoN-o Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:28:44.904730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d3169d3b318421fab1d473a51637437", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d3169d3b318421fab1d473a51637437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: bafdb895190e45ba96e71fd348c41c3f Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:44.906167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '77db89a9-c264-403c-8f45-f52c6360ec03'} Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:28:44.910357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:44.911662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:44.912776 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Returning 404 to user: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:28:44.912776 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3ebfdedc-27b8-47f4-a1d4-42b5e255f62b tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 404 len: 111 microversion: 2.1 time: 0.043279 Aug 23 04:28:44.912776 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 136/249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:44 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:28:45.022925 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:45.025209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:45.031408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.032349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.032981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.033737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.034196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.034609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.048849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] HTTP exception thrown: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Request method failure captured: Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03/os-volume_attachments HTTP/1.1 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc05MKTo3xVT8mGkg_Tl6qQgYkDNTrLWUogRLX-1l42gVAIxzyCx4HGKPVWFNTTDznW9KXO8qva7OUduICSRAWvOyIWNAhsCQUSsa9Go4fAmSqBcvyS3l8z21lKSuGowpzUt_4r8wzP8WOex_Xa01-M1YZ4DPbrhM6NurAL19LoN-o Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:28:45.050563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d3169d3b318421fab1d473a51637437", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d3169d3b318421fab1d473a51637437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: bafdb895190e45ba96e71fd348c41c3f Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:45.051899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'server_id': '77db89a9-c264-403c-8f45-f52c6360ec03'} Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:28:45.052737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:45.053899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:45.055769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Returning 404 to user: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:28:45.056675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4c8b2a6a-11f1-43e2-aa3b-25601d68a29c tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037905 Aug 23 04:28:45.057231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 137/250] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:28:45 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 04:28:45.103669 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:28:45.104188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:28:45.106228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:28:45.106228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:28:45.106228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:28:45.112969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:45.113654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:45.114780 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.115464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.115833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.116586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.117171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.117727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.121605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.122300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.123029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.123988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:45.124543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:45.125080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:45.140099 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Getting quotas for project aec8505d96be450188e176d091286fc4. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:28:45.145405 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Getting quotas for user 9cd4aa1f6a4141289a6ae570fb4db6f1 and project aec8505d96be450188e176d091286fc4. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:28:45.158717 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:28:45.161419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:28:45.212541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c3cf458a-06d6-43c6-bde6-e01d7f8c2063 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456142 Aug 23 04:28:45.219383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 114/251] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:28:45.228720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-de2e8421-478f-4d4f-a53a-c2a8f0dc58a8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:45.229526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-de2e8421-478f-4d4f-a53a-c2a8f0dc58a8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:45.239211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:45.304276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de2e8421-478f-4d4f-a53a-c2a8f0dc58a8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:45.308842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:45.315882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-de2e8421-478f-4d4f-a53a-c2a8f0dc58a8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1214 microversion: 2.1 time: 0.091168 Aug 23 04:28:45.317526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 115/252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:45 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:45.318694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-df0d2381-2f01-4205-ab41-a2736bcc12bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.209504 Aug 23 04:28:45.319516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 138/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:45 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:46.304643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:46.305256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:46.313503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.314272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.314685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.315618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.316189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.316748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.334979 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] HTTP exception thrown: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.338722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:46.339202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Request method failure captured: Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: DELETE /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 HTTP/1.1 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc05MKTo3xVT8mGkg_Tl6qQgYkDNTrLWUogRLX-1l42gVAIxzyCx4HGKPVWFNTTDznW9KXO8qva7OUduICSRAWvOyIWNAhsCQUSsa9Go4fAmSqBcvyS3l8z21lKSuGowpzUt_4r8wzP8WOex_Xa01-M1YZ4DPbrhM6NurAL19LoN-o Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:28:46.339609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d3169d3b318421fab1d473a51637437", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d3169d3b318421fab1d473a51637437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: bafdb895190e45ba96e71fd348c41c3f Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.340857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '77db89a9-c264-403c-8f45-f52c6360ec03'} Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:28:46.341493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.342519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.343676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Returning 404 to user: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:28:46.343676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e1026e68-008d-45e4-9724-f6f4592f2440 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 404 len: 111 microversion: 2.1 time: 0.041395 Aug 23 04:28:46.343676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 116/254] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:28:46 2022] DELETE /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:28:46.349051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:46.349635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:46.349850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.350291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.350717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.351597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.352054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.353101 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.356214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.356687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.357090 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.357962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.358424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.358832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.449099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:46.462456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-283af63c-4274-459d-bb8b-becc2b4f52b0 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1266 microversion: 2.1 time: 0.127758 Aug 23 04:28:46.463670 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 139/255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:46 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:46.468572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:46.469255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] [instance: 77db89a9-c264-403c-8f45-f52c6360ec03] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:46.476707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.477321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.477847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.478884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:46.479210 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:46.479726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:46.495171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] HTTP exception thrown: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Request method failure captured: Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 HTTP/1.1 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc05MKTo3xVT8mGkg_Tl6qQgYkDNTrLWUogRLX-1l42gVAIxzyCx4HGKPVWFNTTDznW9KXO8qva7OUduICSRAWvOyIWNAhsCQUSsa9Go4fAmSqBcvyS3l8z21lKSuGowpzUt_4r8wzP8WOex_Xa01-M1YZ4DPbrhM6NurAL19LoN-o Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:28:46.496889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d3169d3b318421fab1d473a51637437"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d3169d3b318421fab1d473a51637437", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d3169d3b318421fab1d473a51637437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 3d3169d3b318421fab1d473a51637437 Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-DeleteServersTestJSON-884113827 Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: bafdb895190e45ba96e71fd348c41c3f Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-DeleteServersTestJSON-884113827-project Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.498372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '77db89a9-c264-403c-8f45-f52c6360ec03'} Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:28:46.499172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. Aug 23 04:28:46.500468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:28:46.501625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] Returning 404 to user: Instance 77db89a9-c264-403c-8f45-f52c6360ec03 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:28:46.502427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f27e45ef-b4eb-4300-92e6-afdb851eefe9 tempest-DeleteServersTestJSON-884113827 tempest-DeleteServersTestJSON-884113827-project] 10.222.0.18 "GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03" status: 404 len: 111 microversion: 2.1 time: 0.037634 Aug 23 04:28:46.504227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 140/256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:46 2022] GET /compute/v2.1/servers/77db89a9-c264-403c-8f45-f52c6360ec03 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:28:46.636812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:46.645227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b016d216-7cf7-419d-beac-6ed022eacfd0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.302164 Aug 23 04:28:46.650940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 117/257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:46 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:47.483945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:47.484545 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:47.491461 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:47.492285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:47.492918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:47.493659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:47.494276 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:47.494878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:47.665469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:47.666056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:47.673686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:47.674175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:47.674600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:47.675296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:47.675739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:47.676295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:47.802281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:47.817336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b12817fd-fbcc-4953-b5f7-e0e4fff6db47 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.337554 Aug 23 04:28:47.822515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 141/258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:47 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:47.932123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:47.937198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-805ab588-3420-489a-b6dc-0850005af711 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.275451 Aug 23 04:28:47.938206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 118/259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:47 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:48.191040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0f9df8-16ee-49a6-8375-6f50bfa42300", "tag": "237af297-7e33-423a-8b0c-040092197fc3"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:48.201619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:48.202300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:48.202930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:48.214409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] Creating event network-changed:237af297-7e33-423a-8b0c-040092197fc3 for instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 on hv-cinder-85407 Aug 23 04:28:48.220036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-979c78e9-8710-498c-ad77-b93a1fe3f1c6 req-4bbfa4fb-c75c-4273-bf13-7d41fa388111 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040767 Aug 23 04:28:48.220710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 142/260] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:48.839972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:48.840813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:48.848723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:48.849201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:48.849627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:48.850858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:48.851325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:48.851715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:48.962384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:48.964213 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:48.973746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:48.974439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:48.975208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:48.976203 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:48.976884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:48.977438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:49.171776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:49.180983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-469c74ed-0af5-440c-90a2-19f545a32cc2 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.344735 Aug 23 04:28:49.181997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 119/261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:48 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:49.276409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:49.285255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1b9101b7-c36e-480b-98c1-c0518684953c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.328350 Aug 23 04:28:49.286159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 143/262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:48 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:50.204123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:50.205959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:50.214300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:50.215052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:50.216198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:50.217470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:50.218140 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:50.218836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:50.306079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:50.306767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:50.315047 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:50.315604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:50.316212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:50.317159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:50.317851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:50.318326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:50.543069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:50.546931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:50.560355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2ee53cf6-3492-4ef9-b26f-fc270bb5a9b8 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.361378 Aug 23 04:28:50.560890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 120/263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:50 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:50.845154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:50.848939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:50.854310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1cab56ef-6520-4ca1-a860-d5f18114e03b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.552459 Aug 23 04:28:50.854862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 144/264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:50 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:51.582505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:51.583100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:51.589670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:51.590152 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:51.590582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:51.591274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:51.591727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:51.592173 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:51.727365 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:51.735526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fe41bd12-c56c-4add-8267-287cf6a33543 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.156718 Aug 23 04:28:51.736186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 121/265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:51 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:51.875761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:51.876535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:51.883477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:51.883972 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:51.884391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:51.885063 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:51.885501 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:51.885906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:52.023680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:52.032594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a63753a2-80f2-4225-a3bc-3960ad8eab59 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.161004 Aug 23 04:28:52.033028 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 145/266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:51 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:52.245978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-45152c3e-0fea-48c4-98de-59c3e181ff0e tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Action: 'create', calling method: .version_select at 0x7f9c1c1a8b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1359383944", "metadata": {"Type": "work"}}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:52.550659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-45152c3e-0fea-48c4-98de-59c3e181ff0e tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.420018 Aug 23 04:28:52.551280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 122/267] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Aug 23 04:28:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 04:28:52.564006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cdddc2ee-309c-42a0-99e9-9f57a3d73c6d tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c30e160>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:52.621391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cdddc2ee-309c-42a0-99e9-9f57a3d73c6d tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 200 len: 353 microversion: 2.1 time: 0.061708 Aug 23 04:28:52.621930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 146/268] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:28:52 2022] GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:52.759832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:52.760700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:52.770009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:52.770645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:52.771211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:52.772224 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:52.772811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:52.773366 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:52.914419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:52.925094 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f6779770-6ac3-45b5-99b7-9f83ed97ee90 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.171202 Aug 23 04:28:52.925676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 123/269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:52 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:53.054673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.055444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:53.065128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:53.065634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:53.066104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:53.066997 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:53.067481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:53.067896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:53.201712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:53.210458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-70db836f-664e-4242-81fc-94c477d69304 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.160997 Aug 23 04:28:53.211083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 147/270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:53 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:53.634832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cb0f83a2-ac6c-4181-9420-c2843398f6e6 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c066040>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.683710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cb0f83a2-ac6c-4181-9420-c2843398f6e6 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 200 len: 354 microversion: 2.1 time: 0.052686 Aug 23 04:28:53.684286 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 124/271] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:28:53 2022] GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:53.696697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c739b206-3dac-4cf8-bb57-9177e8928af1 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c0759d0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.745163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c739b206-3dac-4cf8-bb57-9177e8928af1 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 200 len: 354 microversion: 2.1 time: 0.052152 Aug 23 04:28:53.745798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 148/272] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:28:53 2022] GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:53.764412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4bc4a6c9-1636-4602-be70-659434fa8f36 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c0d24c0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.835106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4bc4a6c9-1636-4602-be70-659434fa8f36 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 202 len: 0 microversion: 2.1 time: 0.074953 Aug 23 04:28:53.835727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 125/273] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:28:53 2022] DELETE /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 04:28:53.844031 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-45bc957e-3d05-438a-b82d-932d20d5662b tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c096040>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.894621 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-45bc957e-3d05-438a-b82d-932d20d5662b tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 200 len: 353 microversion: 2.1 time: 0.054526 Aug 23 04:28:53.895187 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 149/274] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:28:53 2022] GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:53.946136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:53.946736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:53.953738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:53.954269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:53.954763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:53.955469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:53.955941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:53.956434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:54.100659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:54.108924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-044d88b7-e13f-4d78-b5ab-ea9c0cb5bb43 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.166800 Aug 23 04:28:54.109509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 126/275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:53 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:54.233907 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:54.234616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:54.242044 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:54.242518 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:54.242937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:54.243619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:54.244092 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:54.244487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:54.379339 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:54.387702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f42cf8c3-4dc9-4bda-942b-3631aec62ecb tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.160039 Aug 23 04:28:54.388261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 150/276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:54 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:54.908524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae4d745e-5081-4743-a0fd-d6b5ff3a0cd9 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Calling method '.version_select at 0x7f9c1c1a88b0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:54.937803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-ae4d745e-5081-4743-a0fd-d6b5ff3a0cd9 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] HTTP exception thrown: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae4d745e-5081-4743-a0fd-d6b5ff3a0cd9 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Request method failure captured: Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 HTTP/1.1 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFeET8-siobKdVuAjOYx9A0XPwHO4RmJW1aHJivnF9nrC3fSVQPJa54vFCA5xfn7prNpuSzQaTWunMwRYuPUv9AE3ElQ9EP7NxfoLUyL1eizviRVSTS6BdrUyaV8peEiQdGArPtPogz-2_pQ3vVeHWX94loEMF8A33spI9cvItJoR4E Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 003eb44fe9d44984a8f7bfaa093afab0 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesGetTestJSON-1156637561 Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:28:54.939739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/003eb44fe9d44984a8f7bfaa093afab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/003eb44fe9d44984a8f7bfaa093afab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_003eb44fe9d44984a8f7bfaa093afab0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/003eb44fe9d44984a8f7bfaa093afab0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesGetTestJSON-1156637561 Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 003eb44fe9d44984a8f7bfaa093afab0 Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesGetTestJSON-1156637561 Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesGetTestJSON-1156637561-project Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 2179a4b92c9b47a08491e0b678accda4 Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesGetTestJSON-1156637561-project Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '61561ddd-246b-419f-8fd0-c26aed0b11b2'} Aug 23 04:28:54.941038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. (HTTP 404) (Request-ID: req-fed9d1b5-e006-4828-b9b5-4f581581b36d) Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:54.941924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 04:28:54.943142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 04:28:54.944470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae4d745e-5081-4743-a0fd-d6b5ff3a0cd9 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] Returning 404 to user: Volume 61561ddd-246b-419f-8fd0-c26aed0b11b2 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ae4d745e-5081-4743-a0fd-d6b5ff3a0cd9 tempest-VolumesGetTestJSON-1156637561 tempest-VolumesGetTestJSON-1156637561-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2" status: 404 len: 109 microversion: 2.1 time: 0.036542 Aug 23 04:28:54.945568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 127/277] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:28:54 2022] GET /compute/v2.1/os-volumes/61561ddd-246b-419f-8fd0-c26aed0b11b2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:28:54.956403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0f9df8-16ee-49a6-8375-6f50bfa42300", "name": "network-vif-plugged", "status": "completed", "tag": "237af297-7e33-423a-8b0c-040092197fc3"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:28:54.978399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:54.979180 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:54.979767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:54.992663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] Creating event network-vif-plugged:237af297-7e33-423a-8b0c-040092197fc3 for instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 on hv-cinder-85407 Aug 23 04:28:54.999871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-013bffca-e926-4fe6-b9c5-31cfc7692c96 req-49e8263b-84e1-4ca5-89d1-e2ddbbbbe7de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049802 Aug 23 04:28:55.003525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 151/278] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:28:55.130190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:55.134948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:55.136523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:55.143576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:55.144008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:55.144587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:55.145521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:55.146005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:55.146408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:55.312096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=8 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:55.331673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:55.339404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-57e38735-aa8a-4131-9a01-3914a07a2016 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.210730 Aug 23 04:28:55.339982 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 128/279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:55 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:55.412300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:55.413072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:55.419905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:55.420501 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:55.421016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:55.421810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:55.422508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:55.422989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:55.565864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:55.573871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-06a21a30-b248-4b21-aa61-84d3cf19dc65 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.166307 Aug 23 04:28:55.574548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 152/280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:55 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:56.360989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:56.361885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:56.368620 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:56.369101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:56.369503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:56.370359 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:56.370823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:56.371206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:56.597704 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:56.598634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:56.605748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:56.606354 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:56.606957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:56.607856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:56.608402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:56.608878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:56.792358 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:56.800595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-50151e99-270e-4b75-858a-14ba8735d100 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1314 microversion: 2.1 time: 0.443707 Aug 23 04:28:56.801695 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 129/281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:56 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:56.835662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:56.843456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-341dcf30-deb5-4405-83da-096515663211 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.252186 Aug 23 04:28:56.844166 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 153/282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:56 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:28:57.823545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:57.824178 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:57.831052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:57.831535 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:57.832014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:57.832649 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:57.833087 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:57.833499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:57.866518 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:57.867768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:57.874971 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:57.876320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:57.877016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:57.877896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:57.878344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:57.878757 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:58.022558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:58.031264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4c2232ce-edc0-4f65-a434-762a938eaeb4 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1464 microversion: 2.1 time: 0.212455 Aug 23 04:28:58.032109 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 130/283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:57 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:58.061562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:58.070604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ecf2e786-b36c-40b2-97ee-4b79129872b6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.208905 Aug 23 04:28:58.082073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 154/284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:57 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:58.086984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:58.087493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:58.093962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:58.094910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:58.095103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:58.095940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:58.096881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:58.097611 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:58.124019 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:28:58.219575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-594382c4-ac81-4bb6-ab8c-6f45208b92fd tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 204 len: 0 microversion: 2.1 time: 0.138111 Aug 23 04:28:58.220528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 131/285] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:28:58 2022] DELETE /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:28:58.230391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:58.231086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:58.237804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:58.238287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:58.238714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:58.239445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:58.239985 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:58.240470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:58.376756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:58.385117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-033d3dfc-b442-4639-bded-9e82b4ed2f12 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1470 microversion: 2.1 time: 0.159554 Aug 23 04:28:58.385715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 155/286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:58 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:59.096958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:59.097952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:59.105005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:59.105461 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:59.105884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:59.106584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:59.107176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:59.107738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:59.240261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:59.248030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fa224e83-4bef-4a14-ab05-2d14542af58f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.155363 Aug 23 04:28:59.248586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 132/287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:59 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:28:59.406391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:28:59.407182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:28:59.413639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:59.414122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:59.414566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:59.415272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:28:59.415710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:28:59.416149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:28:59.563634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:28:59.572128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-282c5cb7-509f-49ad-9490-e9f74e50a35a tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1470 microversion: 2.1 time: 0.169475 Aug 23 04:28:59.572775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 156/288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:28:59 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:00.269188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:00.269784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:00.276175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:00.276643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:00.277070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:00.277737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:00.278176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:00.278581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:00.494682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:00.503902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-331d9356-5596-42ad-b104-51910261132b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.238549 Aug 23 04:29:00.505055 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 133/289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:00 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:00.594768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:00.596326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:00.603007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:00.603486 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:00.603906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:00.604612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:00.605073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:00.605476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:00.792570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd4aa1f6a4141289a6ae570fb4db6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec8505d96be450188e176d091286fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:00.800782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-57745fad-cd12-4123-85c0-0c23cf33a76d tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 200 len: 1470 microversion: 2.1 time: 0.211078 Aug 23 04:29:00.801347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 157/290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:00 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:00.961273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0f9df8-16ee-49a6-8375-6f50bfa42300", "name": "network-vif-deleted", "tag": "237af297-7e33-423a-8b0c-040092197fc3"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:00.973929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:00.974824 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:00.975385 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:00.992420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] Creating event network-vif-deleted:237af297-7e33-423a-8b0c-040092197fc3 for instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 on hv-cinder-85407 Aug 23 04:29:00.998467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-5acb9344-034f-40a3-a285-1f834d402277 req-b736746f-b086-415e-aced-fcbe8b8bc662 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042077 Aug 23 04:29:00.999338 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 134/291] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:01.525934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:01.526540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:01.533585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:01.534155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:01.534906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:01.536894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:01.537424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:01.537912 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:01.696628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:01.716192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-30151fd1-23ce-49ba-9b98-f8ad6b950a1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.185972 Aug 23 04:29:01.716192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 158/292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:01 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:01.822965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:01.823697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] [instance: 5e0f9df8-16ee-49a6-8375-6f50bfa42300] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:01.830792 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:01.831258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:01.831683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:01.832401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:01.832956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:01.833380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:01.849355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] HTTP exception thrown: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Request method failure captured: Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 HTTP/1.1 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFd71qWIaBFlVgEME1XoOhh1PyiNCK_7IvpVnJTTfBRKEtlTMDP23c8tlC-OlkcE3Q12A8TL8O0apZs9lDZm1PDzDeOYqthYWRrYGd84IPJmuTZ68hLodAlf0KIaSZqdc_fAlpZiDSmUjSamVPEHQFO5eu7HpFgRpdlSZh73FIMZPzE Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: aec8505d96be450188e176d091286fc4 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesNegativeTest-470926223 Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:29:01.850965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aec8505d96be450188e176d091286fc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aec8505d96be450188e176d091286fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aec8505d96be450188e176d091286fc4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aec8505d96be450188e176d091286fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesNegativeTest-470926223 Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: aec8505d96be450188e176d091286fc4 Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesNegativeTest-470926223 Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesNegativeTest-470926223-project Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 9cd4aa1f6a4141289a6ae570fb4db6f1 Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesNegativeTest-470926223-project Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. Aug 23 04:29:01.852466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '5e0f9df8-16ee-49a6-8375-6f50bfa42300'} Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:29:01.853459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. Aug 23 04:29:01.854900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:01.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] Returning 404 to user: Instance 5e0f9df8-16ee-49a6-8375-6f50bfa42300 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:29:01.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-77c82a9e-fa09-4d7a-aa6e-ce018290dbf6 tempest-VolumesNegativeTest-470926223 tempest-VolumesNegativeTest-470926223-project] 10.222.0.18 "GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300" status: 404 len: 111 microversion: 2.1 time: 0.033647 Aug 23 04:29:01.856624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 135/293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:01 2022] GET /compute/v2.1/servers/5e0f9df8-16ee-49a6-8375-6f50bfa42300 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:29:02.729835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:02.730579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:02.737440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:02.737859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:02.738288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:02.739171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:02.739457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:02.739876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:02.892035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:02.900190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cc3291bd-0199-4868-8d29-61e02fd20a74 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.174158 Aug 23 04:29:02.901158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 159/294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:02 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:03.924666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:03.925278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:03.931809 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:03.932338 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:03.932761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:03.933464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:03.933907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:03.934315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:04.076053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:04.084871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-38332c1e-cbb3-4a87-8986-e5ac5bc63fd3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.164119 Aug 23 04:29:04.085416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 136/295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:03 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:05.110716 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:05.111259 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:05.117612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:05.118086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:05.118521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:05.119196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:05.119640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:05.120101 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:05.258856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:05.267196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5b0ee0dc-afd9-4bed-9f91-911cb65be935 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.162786 Aug 23 04:29:05.267769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 160/296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:05 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:06.290210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:06.290210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:06.296978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:06.297510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:06.298482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:06.299164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:06.299605 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:06.300566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:06.440379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:06.449464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f6ec51f5-c340-4c2f-8d94-9c96f37ad715 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.164972 Aug 23 04:29:06.450107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 137/297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:06 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:07.034691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aebf817-dce7-4fbf-ae0f-6765080194b5", "device": "/dev/sdb"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:07.037639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:07.043738 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:07.044249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:07.044678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:07.045355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:07.045800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:07.046204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:07.336349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bd32cb8b-2ac5-49f3-91db-15bb11105b16 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "POST /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307074 Aug 23 04:29:07.336978 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 161/298] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:29:07 2022] POST /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:07.471571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:07.472205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:07.479470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:07.479989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:07.480484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:07.481250 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:07.481770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:07.482203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:07.614484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:07.622273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5d5a837e-8bfd-4a09-a9f0-6502ac4af2ea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.154845 Aug 23 04:29:07.622900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 138/299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:07 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:08.646569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:08.647511 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:08.654490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:08.654964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:08.655377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:08.656080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:08.656573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:08.656992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:08.792582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:08.800427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ac67a8ad-e5b8-43bb-9195-19c7ebdd2877 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.159022 Aug 23 04:29:08.800998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 162/300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:08 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:09.821419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:09.822458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:09.828720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:09.829234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:09.829658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:09.830445 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:09.830889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:09.831306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:10.007876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:10.017162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7fd3d9f4-3ab1-4593-98e6-603f1cd652ab tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.199637 Aug 23 04:29:10.021042 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 139/301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:09 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:11.037600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:11.038351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:11.041013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=66 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:11.046502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:11.046911 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:11.047566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:11.048287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:11.048726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:11.049343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:11.186183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:11.189898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:11.195184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-976ee62f-5aaa-4c84-9a65-13a2efe1ea7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.161445 Aug 23 04:29:11.195743 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 163/302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:11 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:12.060901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:12.061375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:12.068273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:12.068749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:12.069190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:12.069878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:12.070328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:12.070760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:12.093977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0bd12725-b4b5-44d6-9397-f742704ba33f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/ips" status: 200 len: 153 microversion: 2.20 time: 0.037127 Aug 23 04:29:12.094552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 140/303] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Aug 23 04:29:12 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:29:12.216906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:12.217612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:12.225745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:12.226216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:12.226648 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:12.227342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:12.227788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:12.228237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:12.519551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:12.527669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-452a6084-582e-4a5d-b8ab-18bb4a833952 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.315352 Aug 23 04:29:12.528281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 164/304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:12 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:13.547627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:13.548226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:13.555021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:13.555559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:13.555944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:13.556790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:13.557242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:13.557651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:13.576017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:13.692634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:13.704329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-91e195bb-35ea-4952-849b-0a65fea21496 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.160320 Aug 23 04:29:13.704911 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 141/305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:13 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:14.496676 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:14.497334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:14.503836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.504351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.504770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.505454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.505889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.506308 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.528880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lazy-loading 'flavor' on Instance uuid c0da9656-e0b8-4a68-9062-f3abc68d75f8 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:29:14.727024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a60ca647-0091-4d57-88e8-ed76ac867813 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/action" status: 202 len: 0 microversion: 2.20 time: 0.233836 Aug 23 04:29:14.727876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 165/306] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Aug 23 04:29:14 2022] POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:29:14.732120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:14.732722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:14.736391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:14.737317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:14.739387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.739872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.740332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.741013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.741452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.742048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.752060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.752764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.753189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.753878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:14.754319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:14.754722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:14.964487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:14.966562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:14.973975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:14.975028 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-01a5199c-929d-4156-b45b-43354aaca36c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1521 microversion: 2.1 time: 0.246709 Aug 23 04:29:14.975452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:14.975592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 142/307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:14 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:14.989889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1648b05c-6dc2-4aa3-9461-fa81e4fb4f54 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.257597 Aug 23 04:29:14.990775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 166/308] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:14 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:15.997086 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:15.997778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:16.000435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:16.007205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.007679 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.008133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.008809 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.009249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.009664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.013908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:16.014502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:16.021834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.022314 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.022740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.023432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.023876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.024313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.212187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:16.215481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:16.220327 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-12a1c90e-e14f-448a-93db-976d66a89729 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1501 microversion: 2.1 time: 0.227489 Aug 23 04:29:16.220892 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 143/309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:15 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1501 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:16.224640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:16.226191 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:16.227515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4bdd917e-3599-4e01-8e8b-5c1b6f5ae3c1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.217529 Aug 23 04:29:16.228083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 167/310] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:16 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:16.240268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:16.240872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:16.246747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.247277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.247638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.248352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:16.248768 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:16.249211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:16.398987 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:16.407798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-20da7a02-8289-4469-b45e-4a04faac0d24 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1515 microversion: 2.1 time: 0.171155 Aug 23 04:29:16.408447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 144/311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:16 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:17.252067 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:17.252670 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:17.259521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:17.259995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:17.260439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:17.261113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:17.261553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:17.261964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:17.399207 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:17.408300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:17.409779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:17.410916 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0245dc00-59f3-4b80-a468-53b7306c3d77 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.163324 Aug 23 04:29:17.411477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 168/312] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:17 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:18.435751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:18.436600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:18.444327 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:18.444814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:18.445245 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:18.445934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:18.446406 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:18.446805 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:18.588698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:18.598243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:18.599837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:18.601022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-26af4374-8cb8-4393-b36d-d5fcca73182f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.169689 Aug 23 04:29:18.601712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 145/313] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:18 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:18.999974 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:19.002636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:19.010152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.010661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.011284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.011802 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.012280 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.012707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.040234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'flavor' on Instance uuid cd8238e6-e045-42e6-9bf4-b97507719b1d {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:29:19.119284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bb2bf6f3-7cd2-4b93-9b6c-e86f47cce5f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/action" status: 200 len: 32 microversion: 2.1 time: 0.124037 Aug 23 04:29:19.119886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 169/314] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:29:18 2022] POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:29:19.133194 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:19.133798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:19.140965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.141679 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.142102 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.143448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.143969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.144476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.478198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:19.496757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ba119251-571d-425f-a581-244d1cd94d85 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.367314 Aug 23 04:29:19.504164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 146/315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:19 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:19.626378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:19.627134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:19.650498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.650995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.651430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.652177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:19.652595 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:19.653007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:19.884154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:19.892961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:19.894535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:19.895693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0ab9dda8-3e2c-4d17-8fc4-94fdede2c758 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.275032 Aug 23 04:29:19.896278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 170/316] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:19 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:20.523428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:20.524035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:20.534021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:20.534623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:20.535137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:20.535844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:20.536362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:20.536925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:20.669205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:20.677050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8df14b9b-caf2-44de-b924-1b8da387d6b1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.157515 Aug 23 04:29:20.677622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 147/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:20 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:20.918898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:20.920085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:20.926698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:20.927172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:20.927594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:20.928293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:20.928747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:20.929152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:21.066142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:21.074453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:21.075965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:21.077126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fd57dc3b-d15d-49d5-8a34-927c83e93f91 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.162239 Aug 23 04:29:21.077682 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 171/318] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:20 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:21.698089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:21.698704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:21.706019 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:21.706500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:21.706908 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:21.707973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:21.708534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:21.708986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:21.848884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:21.857428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9417625e-b04d-4425-9139-5a124992bfb9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.163272 Aug 23 04:29:21.858011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 148/319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:21 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:22.100889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:22.101394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:22.107569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:22.108155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:22.108585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:22.109298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:22.109745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:22.110369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:22.249823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:22.258223 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:22.259725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:22.260914 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4414fd27-cf30-4e76-ab4e-c11007f389c5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.165014 Aug 23 04:29:22.261467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 172/320] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:22 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:22.879252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:22.879871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:22.886630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:22.887124 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:22.887550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:22.888271 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:22.888718 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:22.889133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:23.068088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:23.076720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8e621eab-57c8-45f2-915a-977c20e40e3c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.202124 Aug 23 04:29:23.077295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 149/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:22 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:23.283142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:23.283874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:23.293090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:23.293710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:23.294299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:23.295142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:23.295763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:23.296287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:23.439544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:23.449415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:23.450947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:23.452200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a8573867-d93d-4292-8e82-990b1e2a05f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.173150 Aug 23 04:29:23.452730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 173/322] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:23 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:24.100325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:24.100898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:24.109985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:24.110460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:24.111024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:24.111586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:24.112094 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:24.112765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:24.382100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:24.392347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a86845af-8bc0-4dc8-9191-09b6c4af5417 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.298140 Aug 23 04:29:24.393267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 150/323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:24 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:24.476516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:24.477198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:24.483731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:24.484298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:24.484791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:24.485481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:24.485923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:24.486342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:24.619832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:24.629165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:24.630703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:24.631859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6fd054bb-05c8-47a6-a96c-884ae2bb47e7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.159809 Aug 23 04:29:24.632440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 174/324] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:24 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:25.355970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:25.356746 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:25.363385 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.364078 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.364700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.365636 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.366082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.366557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.391676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c84647ce-0544-4562-9292-331fdb50d4cf tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/ips" status: 200 len: 147 microversion: 2.1 time: 0.039695 Aug 23 04:29:25.392309 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 151/325] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:29:25 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:25.414490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:25.415112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:25.423093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.424112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.424549 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.425382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.425851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.426291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.600706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:25.609730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-587936af-ecaf-4158-8f32-dc0330b002bf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.200256 Aug 23 04:29:25.610657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 175/326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:25 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:25.656081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:25.656876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:25.664069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.664597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.665078 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.665797 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:25.666278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:25.666743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:25.828211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:25.837260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:25.838857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:25.840075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ee3700b0-a715-4708-98d5-064d0d90d039 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.188350 Aug 23 04:29:25.840626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 152/327] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:25 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:26.635094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:26.635811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:26.642571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:26.643127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:26.643623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:26.644334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:26.644784 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:26.645243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:26.663745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:26.847385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:26.855770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-028b0f2d-8851-4b21-aa9a-39be0f90a39f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.224835 Aug 23 04:29:26.859808 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 176/328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:26 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:26.865832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:26.866441 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:26.872921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:26.873396 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:26.873980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:26.874877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:26.875328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:26.875748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:27.088486 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:27.097198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:27.099190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:27.100337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7eb336bb-7c60-43f9-8c39-0f4f74ba531b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.239304 Aug 23 04:29:27.100913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 153/329] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:26 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:27.877876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:27.878554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:27.885599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:27.886292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:27.886950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:27.887714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:27.888237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:27.888714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:28.037205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:28.045333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c9fbf715-0524-45a1-baa6-0e81797ef5fe tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.172015 Aug 23 04:29:28.045904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 177/330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:27 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:28.123079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:28.123686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:28.130357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:28.130853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:28.131296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:28.131988 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:28.132429 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:28.132850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:28.264220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:28.272848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:28.275405 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:28.276635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e7287b57-9c49-460e-9e65-8958a1ba7a35 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.157604 Aug 23 04:29:28.277196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 154/331] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:28 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:29:29.066712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:29.067452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:29.079220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.079720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.080188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:29.080910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.081370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.081794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:29.217206 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:29.226505 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d60ed307-75f7-44e1-92d6-df94fd3a0842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.163713 Aug 23 04:29:29.227202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 178/332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:29 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:29.302505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:29.303122 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:29.310481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.311162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.311592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:29.312381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.313175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.313708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:29.472427 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:29.483457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:29.485006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:29.486166 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0994f697-bbc8-4ba1-9bf3-be808d3ff57a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.188042 Aug 23 04:29:29.486711 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 155/333] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:29 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:29.927526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c987f61-50b5-4480-b595-92ebc4b0b178"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:29.929847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:29.936516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.937253 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.937807 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:29.938749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:29.939212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:29.939778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:30.225227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c65d5390-f1d2-4c88-bb58-3c3dd6db3c05 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301821 Aug 23 04:29:30.225835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 179/334] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:29:29 2022] POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:30.248459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:30.249233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:30.257790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:30.258389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:30.258912 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:30.259668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:30.260274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:30.260940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:30.464478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:30.474689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8361ce4a-f743-42bc-badc-aa1f5722990e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.230929 Aug 23 04:29:30.475255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 156/335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:30 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:30.512908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:30.513687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:30.522403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:30.523091 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:30.523469 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:30.524205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:30.524644 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:30.525050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:30.674894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:30.686974 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:30.689476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:30.690988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-64e5fe9a-9a14-406e-bff4-d37bbd84bbf4 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.183397 Aug 23 04:29:30.691627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 180/336] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:30 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:31.244035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:31.244559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:31.250725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.251208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.251632 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.252341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.252787 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.253200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.381520 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lazy-loading 'services' on Instance uuid 8862871b-f595-4169-8c06-96a893427670 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:29:31.490427 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:31.495303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:31.496024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:31.501971 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a39922db-b791-4107-9fb4-f4dd06c561b9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670/os-volume_attachments/0aebf817-dce7-4fbf-ae0f-6765080194b5" status: 202 len: 0 microversion: 2.1 time: 0.261848 Aug 23 04:29:31.502682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 157/337] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:29:31 2022] DELETE /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670/os-volume_attachments/0aebf817-dce7-4fbf-ae0f-6765080194b5 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:29:31.502797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.503230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.503651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.504359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.504797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.505200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.642169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:31.649839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ecc0fbe5-1878-4f55-8f2a-1b6e42fdb0ef tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.158668 Aug 23 04:29:31.650402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 181/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:31 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:31.715730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:31.716481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:31.723385 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.724367 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.724801 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.725479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:31.725931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:31.726344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:31.860255 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:31.873548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:31.876017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:31.877877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5b04ecf5-9f54-49ad-b294-37f073be344e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.166224 Aug 23 04:29:31.878736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 158/339] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:31 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:32.674608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:32.675524 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:32.686782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:32.687606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:32.688438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:32.689472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:32.690145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:32.690842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:32.828742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:32.837076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b76caa48-b95e-4a97-abd1-f86a7b7c0cc0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.168950 Aug 23 04:29:32.837669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 182/340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:32 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:32.905239 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:32.906213 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:32.916913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:32.917727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:32.918394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:32.919557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:32.920306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:32.921032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:33.077401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:33.088352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:33.089844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:33.091000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-778c324a-5431-4c77-a00b-fcb94b008e5e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1746 microversion: 2.20 time: 0.192329 Aug 23 04:29:33.091560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 159/341] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:32 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1746 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:33.858264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:33.858815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:33.865350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:33.865821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:33.866240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:33.866904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:33.867342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:33.867746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:33.996860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:34.004917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ef0a82b6-de40-4d85-9ad9-ae69806ee4f9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.150642 Aug 23 04:29:34.005479 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 183/342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:33 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:34.119152 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:34.120131 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:34.130625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:34.131105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:34.131534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:34.132267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:34.132717 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:34.133139 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:34.279082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:34.287318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:34.288841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:34.289983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a825fe1e-04b6-4338-9931-54cb7de8e6c6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1746 microversion: 2.20 time: 0.178001 Aug 23 04:29:34.290546 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 160/343] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:34 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:35.026277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:35.026880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:35.033150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:35.033624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:35.034041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:35.034724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:35.035162 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:35.035567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:35.166750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:35.175019 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f496b9fb-70be-40de-995e-74b76a12896d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.152592 Aug 23 04:29:35.175618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 184/344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:35 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:35.317056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:35.317661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:35.324305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:35.324779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:35.325208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:35.325891 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:35.326328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:35.326736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:35.470077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:35.479679 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:35.481408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:35.482943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d1c3de03-0669-49ae-9d8b-9e5ce099febb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.169676 Aug 23 04:29:35.483577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 161/345] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:35 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:35.505268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "name": "network-vif-plugged", "status": "completed", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:35.516754 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:35.517726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:35.518920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:35.534559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] Creating event network-vif-plugged:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:29:35.539847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-ae214662-08de-4e83-a835-62fcf3882650 req-f82b4898-33ea-4a2a-9d57-549b51094b3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039233 Aug 23 04:29:35.541074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 185/346] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:36.196193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:36.196977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:36.203322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:36.203872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:36.204399 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:36.205144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:36.205670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:36.206150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:36.364221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:36.372816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a1416841-4f35-4818-88ad-b72e67a1e8f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.180660 Aug 23 04:29:36.373668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 162/347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:36 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:36.507667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:36.512643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:36.521378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:36.521862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:36.522493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:36.523585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:36.524205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:36.524766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:36.717359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:36.728512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:36.730138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:36.731716 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1ae0948d-eadd-4016-a602-52c120b8b1d5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.228896 Aug 23 04:29:36.748190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 186/348] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:36 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:37.397253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:37.398528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:37.405430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:37.407634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:37.407634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:37.407634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:37.407634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:37.408265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:37.578276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:37.588087 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0e87c75c-a3f5-4ab6-a4de-0d8ec3fe1266 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.194884 Aug 23 04:29:37.588661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 163/349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:37 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:37.755661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:37.756306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:37.762840 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:37.763444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:37.764110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:37.764805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:37.765397 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:37.766010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:37.925633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:37.937911 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:37.938550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:37.938989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:37.952240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:37.977924 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:37.981543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:37.982806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9ff7539b-02c3-4e8f-9db4-59a93a883a8d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.231997 Aug 23 04:29:37.983974 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 187/350] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:37 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:38.049973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:38.050850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:38.061733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.062497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.062972 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.063855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.064339 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.064930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.080410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Going to try to stop instance {{(pid=121224) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 04:29:38.092751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:29:38.168497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3756a595-a22f-4c07-a9ee-134bca2e3847 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action" status: 202 len: 0 microversion: 2.1 time: 0.244638 Aug 23 04:29:38.168497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 164/351] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:29:37 2022] POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 04:29:38.191990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:38.191990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:38.199353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.199874 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.200283 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.201097 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.201547 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.201961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.250468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-663af12e-daf4-419d-95d8-469bb6cac4a2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 204 len: 0 microversion: 2.1 time: 0.205695 Aug 23 04:29:38.251061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 188/352] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:29:38 2022] DELETE /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:29:38.256281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:38.256844 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:38.262805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.263280 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.263699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.264405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.264842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.265246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.296443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-41edce03-87d1-4424-8e33-3c89d406e99c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041801 Aug 23 04:29:38.297216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 189/353] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:29:38 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:38.301740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:38.302357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:38.308454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.308923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.309341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.310022 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.310459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.310866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.397963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:38.406464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b131c15e-5854-44fb-a0bf-7e1354739303 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.234628 Aug 23 04:29:38.424034 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 165/354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:38 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:38.501557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:38.510767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-72f4f3f0-181e-4222-84a5-4ed2942474c2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1514 microversion: 2.1 time: 0.212682 Aug 23 04:29:38.511347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 190/355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:38 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:38.612642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:38.613430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:38.622314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.623177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.623788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.625262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:38.625862 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:38.626816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:38.856316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:38.866037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-84d19d62-596a-4d8f-b2ee-29d4ca70f836 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.258601 Aug 23 04:29:38.866842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 166/356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:38 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:39.007453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:39.008307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:39.015786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.016578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.017025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.017765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.018209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.018644 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.024202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:39.178566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:39.187762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:39.193450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:39.194743 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4170fb07-79ef-4947-8da1-9bfa50ff73c0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.191474 Aug 23 04:29:39.195545 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 191/357] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:39 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:39.433331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:39.434543 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:39.441908 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.442629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.443288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.444150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.444766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.445337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.531759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:39.532709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:39.542941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.543421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.543841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.544789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.545219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.545631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.650928 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:39.659986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4da404f3-a249-4d7c-a458-d796dd4eb883 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.230556 Aug 23 04:29:39.661301 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 167/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:39 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:39.734143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:39.743424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c66e2957-32c9-4891-9a54-741edeea7fd0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1514 microversion: 2.1 time: 0.216302 Aug 23 04:29:39.744197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 192/359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:39 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:39.886347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:39.886945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:39.888696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51f9df85-b68d-452a-bd70-471ba7569ab3"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:39.891371 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:39.901333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.902146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.902806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.903461 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.903900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.904345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.909499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.910167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.910774 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:39.911582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:39.912058 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:39.912645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.082666 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:40.091050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6a4afc45-f4ee-4814-ad42-f32aac21ffea tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.208473 Aug 23 04:29:40.092022 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 193/360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:39 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:40.219859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:40.220494 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:40.227468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.227979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.228422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.229103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.229551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.229969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.433783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:40.445390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:40.451157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:40.452736 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-517fd3ac-db27-468e-80a7-e014f07f8063 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.238883 Aug 23 04:29:40.471410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 194/361] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:40 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:29:40.535179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-23cf4a18-10ca-4933-9f5a-62911ce75ff6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657130 Aug 23 04:29:40.537121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 168/362] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:29:39 2022] POST /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:29:40.682017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:40.683033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:40.695201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.695201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.695514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.696255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.696782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.697109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.766970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:40.768009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:40.777624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.778499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.779101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:40.780414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:40.781201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:40.781812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.046365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.061909 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.065069 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-93fa6bac-9a16-4463-9d93-2c930d4d5239 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.387558 Aug 23 04:29:41.070584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-be4fedb8-4b93-4ec8-bdca-35d4a9bd92ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 200 len: 1514 microversion: 2.1 time: 0.308687 Aug 23 04:29:41.071382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 169/363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:40 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:41.080761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 195/364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:40 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:41.113340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:41.114095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:41.124618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:41.125012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:41.125439 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.126117 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:41.127267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:41.127267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.251521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8862871b-f595-4169-8c06-96a893427670", "name": "network-vif-deleted", "tag": "536b7c5c-b80f-4902-b8ed-4f957b02ca82"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:41.261948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:41.265011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:41.265726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:41.266396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.291895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] Creating event network-vif-deleted:536b7c5c-b80f-4902-b8ed-4f957b02ca82 for instance 8862871b-f595-4169-8c06-96a893427670 on hv-cinder-85407 Aug 23 04:29:41.302618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-43d00ea7-7145-444c-97a7-2b73d009eeee req-d1687135-3543-4816-ac98-366f1355829a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054921 Aug 23 04:29:41.312990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 196/365] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:41.336652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.345009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f4140536-962f-423b-91ed-a86cd0418fc6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.235134 Aug 23 04:29:41.359198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 170/366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:41 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:41.476268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:41.476957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:41.485313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:41.485794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:41.486407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.487102 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:41.487548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:41.488036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:41.636824 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.649717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.651407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:41.652609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6b9c4762-d435-46bd-ae03-b1c1926debdb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.181691 Aug 23 04:29:41.653163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 197/367] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:41 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:42.091164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:42.092463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 8862871b-f595-4169-8c06-96a893427670] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:42.092665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:42.093375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:42.099878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.100075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.100383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.100991 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.101264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.101892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.102181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.102726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.102920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.103296 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.103641 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.103832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.123442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] HTTP exception thrown: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Request method failure captured: Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 HTTP/1.1 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFdSwjAzL3tfMap9hSS51BBzFvZ8K7xi63PJTKAd2GoJTMAXX0jzRRt42T_Ng2H-Qsjc5t3ZAgJOStFk2jFlvJkhvfQQGRKm_fBn_ytGI8aB1akENcr6xQ2sSvwDa2o5Z6Fl4omflEbhPMz39Hp71hBNsYBXJ59dg-6Nm0XfllZ-h5Y Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 57d3d5a2a0514d7687e794f8a678cff9 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:29:42.133016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_57d3d5a2a0514d7687e794f8a678cff9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 57d3d5a2a0514d7687e794f8a678cff9 Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesSnapshotTestJSON-855161699-project Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 4eb4a476712c492da2313ef426001e33 Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesSnapshotTestJSON-855161699-project Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. Aug 23 04:29:42.134584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '8862871b-f595-4169-8c06-96a893427670'} Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:29:42.135517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. Aug 23 04:29:42.136955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:29:42.145009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Returning 404 to user: Instance 8862871b-f595-4169-8c06-96a893427670 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:29:42.145009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-05eff428-7fde-40f5-8a30-04e85fb973ed tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670" status: 404 len: 111 microversion: 2.1 time: 0.047200 Aug 23 04:29:42.145009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 171/368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:42 2022] GET /compute/v2.1/servers/8862871b-f595-4169-8c06-96a893427670 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:29:42.262212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:42.275097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-11f716c6-45c6-40ac-98d0-ff64524ea590 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.184385 Aug 23 04:29:42.275097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 198/369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:42 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:42.366437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:42.367631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:42.374491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.374984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.377889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.379866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.379866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.380093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.537559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:42.541437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:42.548380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-05171f69-8fe5-4fd8-bdb1-a1179017c8f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.186041 Aug 23 04:29:42.551408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 172/370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:42 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:42.676820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:42.677731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:42.686231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.686853 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.687396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.688204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:42.688715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:42.689202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:42.862093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:42.870699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:42.872193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:42.873363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f55d9f8f-4d74-4270-beb3-8d32a17edd14 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.200825 Aug 23 04:29:42.873917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 199/371] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:42 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:43.296813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:43.298191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:43.305764 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.306297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.306783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:43.307480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.307938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.308363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:43.465323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:43.476051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f9745d33-d9fa-4f97-8169-334c1040ee7d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.186083 Aug 23 04:29:43.476920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 173/372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:43 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:43.571542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:43.572987 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:43.580889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.581453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.581938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:43.582808 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.583311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.583786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:43.726860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:43.735351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-69ece031-0f36-4fe7-afa0-9b250a6446de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.168314 Aug 23 04:29:43.748169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 200/373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:43 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:43.902753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:43.903774 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:43.914548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.915191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.915640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:43.918876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:43.919417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:43.920414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:44.078418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:44.088756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:44.090265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:44.091418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b09e9954-c96c-4006-9c04-0d65b26dda32 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.198067 Aug 23 04:29:44.107516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 174/374] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:43 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:44.497247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:44.498142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:44.504620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:44.505236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:44.505511 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:44.506188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:44.506627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:44.507040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:44.650456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:44.661279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ce523b0c-c336-400d-9f95-853b3466fe7a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.167892 Aug 23 04:29:44.661868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 201/375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:44 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:44.757757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:44.758420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:44.765128 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:44.765637 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:44.766066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:44.766753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:44.767224 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:44.767649 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:44.906468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:44.914658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-080a8ef0-68ec-4792-a6c7-a541ea552c8b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.160837 Aug 23 04:29:44.915222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 175/376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:44 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:45.117139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:45.117770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:45.125499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.126263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.126964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:45.128314 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.128996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.130183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:45.284834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:45.293111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:45.294600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:45.295759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e7f3ed23-9f81-4c60-974d-2b116dfd1d63 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.183461 Aug 23 04:29:45.296302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 202/377] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:45 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:45.686262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:45.686992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:45.693962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.694471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.694898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:45.695583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.696057 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.696468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:45.834400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:45.844604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-34fbcf40-bdd5-4d9d-9c30-28266dbbf344 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.165295 Aug 23 04:29:45.845229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 176/378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:45 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:45.939048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:45.940127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:45.947557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.948059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.948479 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:45.949159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:45.949597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:45.950006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:46.084640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:46.092424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d5803cb1-8bf2-4393-b937-4068647e80f1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.159757 Aug 23 04:29:46.092995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 203/379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:45 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:46.322989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:46.323851 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:46.326781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=68 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:46.334379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:46.334855 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:46.335283 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:46.335997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:46.336428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:46.336841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:46.480172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:46.488603 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:46.490123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:46.491275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b88c3ae4-30f5-4c8d-ad8f-9b07948d098c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1741 microversion: 2.20 time: 0.174996 Aug 23 04:29:46.491828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 177/380] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:46 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:46.876885 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:46.877722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:46.888890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:46.889441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:46.889956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:46.891221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:46.891221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:46.891945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:47.030520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:47.038745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e7052c43-e6e2-4a64-8915-fbb18a0705e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.170305 Aug 23 04:29:47.039274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 204/381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:46 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:47.116710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:47.117555 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:47.127207 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:47.127979 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:47.128721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:47.130157 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:47.131243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:47.132537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:47.306099 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:47.318633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-12cee3b3-2b62-49ee-b68e-0fc6c587a6bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.207288 Aug 23 04:29:47.319423 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 178/382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:47 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:47.517742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:47.518610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:47.529577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:47.530362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:47.531060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:47.532234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:47.533005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:47.533686 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:47.680121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:47.688581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:47.690051 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:47.691196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-311c0acb-7d36-41bc-b456-60e248bb8371 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1723 microversion: 2.20 time: 0.180133 Aug 23 04:29:47.691780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 205/383] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:47 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:48.059271 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:48.059893 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:48.065998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.066477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.066935 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.067712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.068201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.068624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.201713 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:48.210153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3d3aa109-d264-43e9-af9c-8e1c7b5ec980 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.155061 Aug 23 04:29:48.210715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 179/384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:48 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:48.349267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:48.349950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:48.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.358509 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.359008 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.359805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.360391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.360869 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.501118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:48.509417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4cab5d17-abb7-47ba-8c68-6037346f022d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.166861 Aug 23 04:29:48.510015 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 206/385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:48 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:48.718524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:48.719400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:48.730799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.731623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.732413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.733665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:48.734483 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:48.735176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:48.872461 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:48.883762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:48.885328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:48.886474 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-95f747ef-df29-473d-9ef8-c9885ab8f42b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1723 microversion: 2.20 time: 0.174618 Aug 23 04:29:48.886997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 180/386] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:48 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:49.240687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:49.241616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:49.252142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.252941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.253626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.254679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.255160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.255654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.388646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:49.397502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-11cbbe03-060e-470e-989b-5060b081b4ab tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.163219 Aug 23 04:29:49.398036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 207/387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:49 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:49.533645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:49.534640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:49.546003 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.546788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.547551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.548715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.549449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.550333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.758554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:49.768967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-464c4966-25f9-4f24-87b2-f0307ee7c331 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.241786 Aug 23 04:29:49.780197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 181/388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:49 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:49.780561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "name": "network-vif-unplugged", "status": "completed", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:49.789944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.790408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.790825 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.802862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] Creating event network-vif-unplugged:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:29:49.808242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-84a30108-17d8-4d69-b9b4-19aa06cafc44 req-709c2de4-c570-4076-9c6a-212561dc7160 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032520 Aug 23 04:29:49.808893 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 208/389] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:29:49.913943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:49.914534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:49.923417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.923960 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.924500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:49.925288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:49.925784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:49.926406 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.125520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1074460491", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "networks": [{"uuid": "5b36f391-9303-491b-a896-5de83bacd8ff"}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:50.141178 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:50.149816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:50.151300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:50.152477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-65e4bf51-7ce1-4e9a-a00b-ec51bb3fe6d8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1723 microversion: 2.20 time: 0.244357 Aug 23 04:29:50.153022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 182/390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:49 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:50.178426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] validate_networks() for [('5b36f391-9303-491b-a896-5de83bacd8ff', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:29:50.311096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-48c8baa3-ed55-4e5d-9fdb-81c3ef71051a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: .version_select at 0x7f9c1c296ca0>, body: {"keypair": {"name": "tempest-keypair-2078470877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUYsv6fP6+KQd1QTQ+02rWa5e4xmvkIMev6dcyriRpuUL8X/T1xjechrGAizRkaNpcAE94YS/6bC+YfExHEl/6LH4jOd+f495Ry7yj9Q8lsoe9LvIkr4YMJktx+uhDVqw=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:50.328508 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-48c8baa3-ed55-4e5d-9fdb-81c3ef71051a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:29:50.333226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-48c8baa3-ed55-4e5d-9fdb-81c3ef71051a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:29:50.356826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-48c8baa3-ed55-4e5d-9fdb-81c3ef71051a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049419 Aug 23 04:29:50.357437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 183/391] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:29:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:50.419598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:50.420839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:50.428482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.429116 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.429795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.430302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.430799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.431217 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.651067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:50.659804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-61f5cff1-9a0e-4968-b3db-0bfa1511f7f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.244880 Aug 23 04:29:50.672018 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 184/392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:50 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:50.684072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:29:50.684533 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:29:50.685101 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:29:50.685554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:29:50.686073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:29:50.695346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.695826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.696293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.697010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.697671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.698086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.704800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:50.716344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Getting quotas for project 57d3d5a2a0514d7687e794f8a678cff9. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:29:50.720415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Getting quotas for user 4eb4a476712c492da2313ef426001e33 and project 57d3d5a2a0514d7687e794f8a678cff9. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:29:50.732874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:29:50.735714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:29:50.793778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:50.794509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:50.795232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-193c6435-34df-4ec8-aa53-3d324ec5746e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674653 Aug 23 04:29:50.801832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 209/393] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 04:29:50.803380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.804033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.804573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.805350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:50.806073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:50.806563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:50.808192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-aa91e28b-0d8b-4d3e-82a9-7ad456b14b56 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:50.810880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-aa91e28b-0d8b-4d3e-82a9-7ad456b14b56 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:50.886223 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-aa91e28b-0d8b-4d3e-82a9-7ad456b14b56 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:50.894562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-aa91e28b-0d8b-4d3e-82a9-7ad456b14b56 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1219 microversion: 2.1 time: 0.091258 Aug 23 04:29:50.895553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 210/394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:50 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:51.052884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.064071 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b5ef6673-c679-4eb6-a643-43c7a086b194 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.277076 Aug 23 04:29:51.064919 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 185/395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:50 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:51.176705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:51.177248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:51.184428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.184995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.185415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.186097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.186695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.187103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.334386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.343032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.344560 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.345712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b5566ef1-f6d9-48b6-82db-e8d67f3cbcbe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1723 microversion: 2.20 time: 0.174347 Aug 23 04:29:51.346275 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 211/396] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:51 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:51.684612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:51.685173 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:51.692196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.692683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.693112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.693973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.694421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.694837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.829901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.839890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b6cd0f28-bf71-4694-a32e-ccf899702400 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.159610 Aug 23 04:29:51.840487 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 186/397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:51 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:51.915536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:51.916232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:51.922647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.923237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.923653 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.924351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:51.924794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:51.925204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:51.936568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-964343199", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c6be732-b40b-47aa-8b96-da7512121793"}], "security_groups": [{"name": "tempest-securitygroup--224706866"}], "key_name": "tempest-keypair-2078470877", "user_data": "}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:51.988384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:51.996412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b8e45135-fceb-41bc-8056-220531db1be9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1223 microversion: 2.1 time: 0.084751 Aug 23 04:29:51.997132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 212/398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:51 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:52.044879 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] validate_networks() for [('8c6be732-b40b-47aa-8b96-da7512121793', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:29:52.085626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:52.086240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:52.092499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.092981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.093412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.094094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.094564 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.094978 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.528527 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:52.536613 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5b39f9a6-5589-4c60-b484-c839a21bdc18 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1501 microversion: 2.1 time: 0.455335 Aug 23 04:29:52.537178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 213/399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:52 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1501 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:52.546799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:52.547363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:52.553677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.554150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.554592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.555266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.555697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.556099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.759204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:52.767814 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:52.769410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:52.770619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-165dc314-5d15-4425-b9d1-dbf9e5cb93db tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1723 microversion: 2.20 time: 0.227607 Aug 23 04:29:52.771140 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 214/400] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:52 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:52.775833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15a642cb-55c6-4051-9f65-6e5077392cda"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:52.778277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:52.784412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.784894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.785320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.786143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:29:52.786634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.786730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:29:52.786813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.786947 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:29:52.787090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.787375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:29:52.787959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:29:52.796997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.797460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.798053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.798757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.799192 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.799598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.810847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] HTTP exception thrown: Cannot 'attach_volume' instance cd8238e6-e045-42e6-9bf4-b97507719b1d while it is in vm_state rescued Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Request method failure captured: Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/os-volume_attachments HTTP/1.1 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 74 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc0ZcWOfD09VgBkNMQks-2q_GIo4BRXRof3RM6BbKzpwtDWywIRWIJeE1W8jipzNLnd-sKa4mPw54-poBJBHjDQ7HVOFy4SCgMCcm7yEYbJrtLqcQDBNnEe63Q4Ud7yu-miwuUchxy8MEN4VlfA0XCl8GQj4QsmrL02FxGDFljMWLg Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:29:52.812830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c113bdd75f254073abcfbd109dc7d187", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 820b9a99be574eb8b09629988c4c59c0 Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {"volumeAttachment": {"volumeId": "15a642cb-55c6-4051-9f65-6e5077392cda"}} Aug 23 04:29:52.814242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Cannot 'attach_volume' instance cd8238e6-e045-42e6-9bf4-b97507719b1d while it is in vm_state rescued Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'server_id': 'cd8238e6-e045-42e6-9bf4-b97507719b1d', 'body': {'volumeAttachment': {'volumeId': '15a642cb-55c6-4051-9f65-6e5077392cda'}}} Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:29:52.815188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cd8238e6-e045-42e6-9bf4-b97507719b1d while it is in vm_state rescued Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:29:52.816356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cd8238e6-e045-42e6-9bf4-b97507719b1d while it is in vm_state rescued Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Returning 409 to user: Cannot 'attach_volume' instance cd8238e6-e045-42e6-9bf4-b97507719b1d while it is in vm_state rescued {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f29592aa-590b-4446-8bd9-73d1b4db11a4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042099 Aug 23 04:29:52.818414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 215/401] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:29:52 2022] POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 04:29:52.819122 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:29:52.821441 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:29:52.823691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:52.824298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:52.830229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.830705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.831130 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.831948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.832390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.832518 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:29:52.833449 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.834904 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:29:52.883535 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a28f57b6-f0a1-4654-b92e-25576247c10e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.951411 Aug 23 04:29:52.889962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 187/402] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:29:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:29:52.889962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:52.889962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:52.897320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.897811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.898240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.899042 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:52.899499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:52.899931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:52.918702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e823fb24-6d48-48e0-a1e3-1c4f695e5842 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.098660 Aug 23 04:29:52.920328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 216/403] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:29:52 2022] POST /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:29:52.927261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6a044a10-2d2a-4872-b984-550acc250d73 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:52.928193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6a044a10-2d2a-4872-b984-550acc250d73 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:53.003635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6a044a10-2d2a-4872-b984-550acc250d73 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:53.013346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6a044a10-2d2a-4872-b984-550acc250d73 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1241 microversion: 2.1 time: 0.091188 Aug 23 04:29:53.014218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 217/404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:52 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:53.020492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:53.021302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:53.032681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.034103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.034672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:53.036625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.037498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.038399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:53.116431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:53.126962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6d0d74fe-5ebe-4322-9331-1d9e84f17b4a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.241392 Aug 23 04:29:53.127540 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 188/405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:52 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:53.133095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:53.133862 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:53.141403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.142257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.143004 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:53.144154 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.144924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.145516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:53.210186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:53.220032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2ce1ce73-c158-4589-887a-4749750a452e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1509 microversion: 2.1 time: 0.203861 Aug 23 04:29:53.220872 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 218/406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:53 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:53.259765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:53.271093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2afb9f3f-608e-4876-a56f-85ec39881adf tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1215 microversion: 2.1 time: 0.142235 Aug 23 04:29:53.273105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 189/407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:53 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:53.797802 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:53.799215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:53.806117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.806602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.806999 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:53.807712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:53.808186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:53.808603 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.038145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:54.043531 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.045685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.053076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.054815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.056302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-231b1248-0410-4743-9482-572f937c054c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1726 microversion: 2.20 time: 0.265071 Aug 23 04:29:54.056667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.057164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.057594 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.057851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 219/408] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:53 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:54.062231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.062992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.063595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.079791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6e83de2-082a-4c01-bd00-451f2d5ece6c"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:54.082612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.089073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.089548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.091462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.092392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.093018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.093575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.217607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.230121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6201572a-0931-47cd-af19-cced8fe074ea tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1237 microversion: 2.1 time: 0.198002 Aug 23 04:29:54.245041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 190/409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:54 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1237 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:54.250466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:54.251506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.258347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.259175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.259818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.260745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.261929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.262414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.267869 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:54.427259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.442264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e9b73b56-c540-4a45-9dca-df452d24364a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.194591 Aug 23 04:29:54.443258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 191/410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:54 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:54.448692 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:54.449296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.455218 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.455977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.456609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.457577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.458227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.458830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.471997 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c5e06de8-aedf-4415-920a-bfa022108697 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396014 Aug 23 04:29:54.473229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 220/411] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Aug 23 04:29:54 2022] POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:29:54.478184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:54.479037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.485897 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.486507 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.487326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.488201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.488822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.489780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.600411 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.610229 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-76c0234c-d6e0-4055-ad2e-55a9bb0dd3ef tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1277 microversion: 2.1 time: 0.135713 Aug 23 04:29:54.613155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 221/412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:54 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:54.638396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:54.638970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.645177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.645655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.646071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.647034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.647619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.648197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.710576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121223) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 04:29:54.765515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.775005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-21ceae40-a9bd-4d0e-aa3a-e7b0c4b033d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1509 microversion: 2.1 time: 0.330411 Aug 23 04:29:54.789552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 192/413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:54 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:54.814002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1bf633e3-1013-4450-a3ed-5198adeefa55 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/action" status: 202 len: 0 microversion: 2.20 time: 0.179604 Aug 23 04:29:54.814660 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 222/414] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Aug 23 04:29:54 2022] POST /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 23 04:29:54.832590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:54.834198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:54.840556 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.840891 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.841323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.842107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:54.842560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:54.842975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:54.984291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.997243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:54.999162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:55.000372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f2d96147-98b3-49dc-9930-b30987c24998 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1752 microversion: 2.20 time: 0.177075 Aug 23 04:29:55.000930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 193/415] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:54 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:55.253459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:55.254791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:55.260868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.261336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.262002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.262923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.263575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.264133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.340602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:55.349909 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-aa03f001-b957-40b6-ade6-52a4e412b2de tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1299 microversion: 2.1 time: 0.100842 Aug 23 04:29:55.350685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 223/416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:55 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:55.465808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:55.466576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:55.474491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.474974 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.475434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.476310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.477015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.477428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.580074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673892ed-32af-43be-922d-f213ecde867f", "tag": "9c6f5b85-1738-4921-9eb1-fc2dc06098a1"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:55.590252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.590876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.591299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.595165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:55.606447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] Creating event network-changed:9c6f5b85-1738-4921-9eb1-fc2dc06098a1 for instance 673892ed-32af-43be-922d-f213ecde867f on hv-cinder-85407 Aug 23 04:29:55.611765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-ee83c35c-2510-4bb7-9e7f-2102d03b2e79 req-4e019898-3081-4284-ad0a-51fe592d5380 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035424 Aug 23 04:29:55.613009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 224/417] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:55.643003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:55.643719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:55.651462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.651962 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.652391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.653245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.653699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.654118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.662572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:55.671503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b448a388-0e5d-4e9c-bd11-b4d9dd6af4e4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1724 microversion: 2.1 time: 0.211639 Aug 23 04:29:55.683980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 194/418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:55 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:55.789360 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:55.797236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5a9453f4-3bd5-4a27-9c9d-75df846486ac tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.163913 Aug 23 04:29:55.797789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 225/419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:55 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:55.799115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:55.799766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:55.806209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.806793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.807242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.807981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:55.808606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:55.809243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:55.944650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:55.952891 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cbe14114-f48b-49dd-b5fe-7c227a42eac6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1509 microversion: 2.1 time: 0.157958 Aug 23 04:29:55.953453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 195/420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:55 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:56.027577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:56.028393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:56.034585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.035050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.035471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.036186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.036623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.037035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.175615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:56.185454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:56.187288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:56.189188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-72e68284-6518-4b97-816e-d602345a0469 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1752 microversion: 2.20 time: 0.167245 Aug 23 04:29:56.189850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 226/421] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:56 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:56.372459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:56.373166 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:56.379314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.379794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.380242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.380921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.381369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.381784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.444576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:56.452481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-de0c7c62-4523-47f6-9475-12f0f5e9b911 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1299 microversion: 2.1 time: 0.083995 Aug 23 04:29:56.453041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 196/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:56 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:56.694481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:56.695780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:56.702786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.703286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.704001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.704710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.705166 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.705803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.819119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:56.819740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:56.830144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.830642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.831073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.831778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.832321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.832748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:56.875339 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:56.886368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4bd0756f-7360-49f0-bed3-38a1a6831af6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1701 microversion: 2.1 time: 0.196038 Aug 23 04:29:56.887362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 227/423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:56 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1701 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:56.915485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:56.926955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:56.928017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:56.929420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.016770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Going to try to start instance {{(pid=121223) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 04:29:57.048778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.057719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2ce6bf73-dd9a-40a4-b3d0-1deb17d7dbc6 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.243347 Aug 23 04:29:57.059065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 197/424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:56 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:29:57.064034 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:57.064705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:57.072868 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.073465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.074326 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.075285 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.076024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.076227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-793ca0ec-8978-48af-9340-ff051143a502 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action" status: 202 len: 0 microversion: 2.1 time: 0.166035 Aug 23 04:29:57.076742 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.077087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 228/425] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:29:56 2022] POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:29:57.088064 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:57.089734 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:57.103357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.103897 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.104419 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.105358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.105832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.106705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.382973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.404961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4c9ce5a8-dd87-40f0-88e7-12e68ccae6c5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1515 microversion: 2.1 time: 0.344580 Aug 23 04:29:57.405918 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 198/426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:57 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1515 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:57.412001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:57.412878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:57.419642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.420511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.421158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.422050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.422679 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.423277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.623951 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.634172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-93df1d5c-c8d5-4c7b-893d-13483a28141e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1710 microversion: 2.1 time: 0.552323 Aug 23 04:29:57.640261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 229/427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:57 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1710 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:57.645200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:57.645955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:57.653074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.653550 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.653973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.654656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:57.655119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:57.655535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:57.861593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.869858 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b2d727ed-8481-4825-a7cd-2cc28f506070 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.233780 Aug 23 04:29:57.870752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 230/428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:57 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:57.921468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.930810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.932379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:57.933551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-14aba96f-f13e-489a-8e48-a9e45863cd65 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1754 microversion: 2.20 time: 0.526534 Aug 23 04:29:57.934574 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 199/429] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:57 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1754 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:58.080090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:58.080703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:58.086773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.087270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.087694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.088402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.089102 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.089775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.276978 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:58.284691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2ccacec4-2705-46c2-9e8e-1ef5c13982c9 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.208620 Aug 23 04:29:58.285299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 231/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:58 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:58.406205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703", "tag": "8bf60682-c074-41e8-9a64-cd742841f206"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:58.415784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.416292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.416712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.427533 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] Creating event network-changed:8bf60682-c074-41e8-9a64-cd742841f206 for instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 on hv-cinder-85407 Aug 23 04:29:58.432483 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-6151ba4c-8298-459c-a1a1-7e69f709697a req-338f07f0-2293-4a20-901b-cd9dbe75aa7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029984 Aug 23 04:29:58.433064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 200/431] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:58.655353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:58.655943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:58.662153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.662629 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.663040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.663694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.664165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.664570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.817362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:58.825714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-78b55ad4-4a38-405c-84c7-097e796d160e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1710 microversion: 2.1 time: 0.174164 Aug 23 04:29:58.826287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 232/432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:58 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:58.891834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:58.892560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:58.898719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.899197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.899977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.900661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.901107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.901519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.904780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9df21666-51b5-4e94-bb3a-1b81a7983563 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: .version_select at 0x7f9c16fe1280>, body: {"keypair": {"name": "tempest-keypair-685386298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcWwRVcGZOwv125KKJ13yyXGDH6zy/hxeyFkkLtewi0ec3P39mYeBTgs8Bx8JjMu3I/DfquJWs1XwDZYWY+zTMCzpt0JDCvMclckefvCiJ9nPZScaCJsrDHiwzXYDmWCg=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:29:58.915193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:58.922489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-9df21666-51b5-4e94-bb3a-1b81a7983563 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for project c113bdd75f254073abcfbd109dc7d187. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:29:58.927232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-9df21666-51b5-4e94-bb3a-1b81a7983563 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for user 820b9a99be574eb8b09629988c4c59c0 and project c113bdd75f254073abcfbd109dc7d187. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:29:58.953052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9df21666-51b5-4e94-bb3a-1b81a7983563 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052192 Aug 23 04:29:58.953939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 233/433] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:29:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:29:58.967496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:58.967496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:58.974465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.974942 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.975367 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:58.976080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:58.976523 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:58.976929 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:59.072910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:59.081898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d375895e-7aac-4a24-90db-ecf9b33b9e50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.194759 Aug 23 04:29:59.082757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 201/434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:58 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:59.160628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:59.169260 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:59.170735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:59.171880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c6e554ea-2a2d-4c34-b5f3-82e4d5e6e933 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.211037 Aug 23 04:29:59.172466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 234/435] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:29:58 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:29:59.305429 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:59.306085 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:59.312299 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:59.312775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:59.313202 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:59.313884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:59.314324 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:59.314738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:59.487103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:29:59.494872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cb564e65-6673-4a17-8e89-2925424d13a1 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.194074 Aug 23 04:29:59.495472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 202/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:59 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:29:59.855242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:29:59.855841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:29:59.862427 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:59.862903 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:59.863357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:29:59.865883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:29:59.866360 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:29:59.866750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.009087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.017770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-abdb8fe4-ffd5-4593-822a-3ce6c6fc7ad6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1710 microversion: 2.1 time: 0.166427 Aug 23 04:30:00.018445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 235/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:29:59 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:00.105071 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:00.106428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:00.116211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.117387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.117876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.119620 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.120680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.121263 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.197635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:00.198377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:00.205250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.206000 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.206664 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.208500 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.209293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.209935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.306708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.315776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a4ea36d6-5bb2-4696-8ad9-36eff67cc318 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.215517 Aug 23 04:30:00.316708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 203/438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:00 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:00.370025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.379568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.381211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.382330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e6f29289-8d3d-4760-b87e-3a82ee179664 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.189068 Aug 23 04:30:00.382890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 236/439] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:00 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:00.516859 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:00.517477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:00.524267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.525035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.525469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.526155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:00.526585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:00.527239 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:00.578710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1615655346", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd742f53-022c-4e81-afc1-52562ecc925b"}], "security_groups": [{"name": "tempest-securitygroup--1519446005"}], "key_name": "tempest-keypair-685386298", "user_data": "}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:00.696654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:00.705087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:00.711427 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-72c8a488-dc26-4b49-ad25-746b3b57602b tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.200106 Aug 23 04:30:00.712043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 204/440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:00 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:00.723391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] validate_networks() for [('fd742f53-022c-4e81-afc1-52562ecc925b', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:30:01.041356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:01.043209 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:01.049587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.050076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.050528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.051376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.053374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.053838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.236268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:30:01.237097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:30:01.237520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:30:01.238004 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:30:01.238889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:30:01.263278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.265473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.266458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.268661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.269752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.270658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.304697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:30:01.311088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Getting quotas for user 820b9a99be574eb8b09629988c4c59c0 and project c113bdd75f254073abcfbd109dc7d187. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:30:01.328478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:30:01.333713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:30:01.381319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.391987 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-aa4e8ab1-f117-44a7-9c38-3b01062737bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1714 microversion: 2.1 time: 0.356043 Aug 23 04:30:01.393023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 205/441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:01 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1714 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:01.411695 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:01.413912 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:01.418890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f018933b-140b-44fc-92fd-6a5d1553711e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.844933 Aug 23 04:30:01.420252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 237/442] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:30:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:30:01.425552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:01.426615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:01.434158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.435230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.435873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.436864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.437504 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.438113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.450121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.458460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.461312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.463670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.464465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.466630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.642968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.652466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.654037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.655269 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e3715586-4409-4b31-8406-c43cdd955414 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.233788 Aug 23 04:30:01.673441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 238/443] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:01 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:01.679125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7bfe96ea-61b2-4211-81c6-7b89ad4fd404 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:01.679436 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7bfe96ea-61b2-4211-81c6-7b89ad4fd404 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:01.833360 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7bfe96ea-61b2-4211-81c6-7b89ad4fd404 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.854001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7bfe96ea-61b2-4211-81c6-7b89ad4fd404 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1245 microversion: 2.1 time: 0.171626 Aug 23 04:30:01.854001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 239/444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:01 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:01.874466 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:01.885482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7bae7f94-84bb-4a7c-b8e7-088fc8c2c685 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.490621 Aug 23 04:30:01.886065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 206/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:01 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:01.895292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:01.897906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:01.909747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.911101 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.916002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:01.917161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:01.918481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:01.919582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.146282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:02.154527 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5d91c080-425e-4a0e-a34b-0dc9539e2ab3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.304805 Aug 23 04:30:02.155111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 240/446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:01 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:02.688244 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:02.688818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:02.696620 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.697111 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.697537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.698410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.698864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.699278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.807659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:02.827571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=10 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:02.840986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:02.850497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:02.851963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:02.853134 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8bcaff62-e7de-4baf-ab62-79602fa3bd9f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.179763 Aug 23 04:30:02.853690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 207/447] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:02 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:02.873831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:02.874498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:02.881707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.882181 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.882604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.883294 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.883740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.884169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.906265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:02.906867 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:02.913965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.914476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.914900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.915554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:02.916020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:02.916431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:02.939201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:02.954072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:02.963742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6f9f3706-dd58-4c90-a29f-8dd0980d6731 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.093688 Aug 23 04:30:02.964352 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 241/448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:02 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:03.116213 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:03.124121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-13836a74-a622-4658-9099-2214bc4e4e05 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.221607 Aug 23 04:30:03.124685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 208/449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:02 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:03.175979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:03.176892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:03.185468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:03.186136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:03.186780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:03.187820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:03.188401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:03.188817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:03.329032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:03.338411 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-57dbd5ac-6e36-47f0-8eb7-66c6d134c8e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.166271 Aug 23 04:30:03.338980 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 242/450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:03 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:03.876936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673892ed-32af-43be-922d-f213ecde867f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6f5b85-1738-4921-9eb1-fc2dc06098a1"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:03.879989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:03.880448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:03.889860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:03.890378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:03.890822 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:03.891701 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:03.892185 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:03.892761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:03.893995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:03.894691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:03.897286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:03.902686 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:03.914827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] Creating event network-vif-plugged:9c6f5b85-1738-4921-9eb1-fc2dc06098a1 for instance 673892ed-32af-43be-922d-f213ecde867f on hv-cinder-85407 Aug 23 04:30:03.923325 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-4fea2135-f0c7-4509-a226-de210b5b8f21 req-ead2d7de-5460-4ae1-9b6e-d0f1d1900fc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050219 Aug 23 04:30:03.924763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 243/451] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:03.987110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:03.989106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:04.000109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.000975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.001803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.002901 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.003582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.004964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.048321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.057731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.059221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.060489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3df42973-3d53-4a0f-9381-236338c98616 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.185354 Aug 23 04:30:04.061686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 209/452] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:03 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:04.104558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.112540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a1997263-cf4b-4a55-983d-b0a818804f1e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.131347 Aug 23 04:30:04.113096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 244/453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:03 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:04.147575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:04.148563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:04.156794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.157574 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.158182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.158882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.159328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.159741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.297709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.306106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-da27bfaa-6dfd-47a0-81a6-6b9b141e92a4 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.163724 Aug 23 04:30:04.306770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 210/454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:04 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:04.360410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:04.360935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:04.368528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.369052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.369480 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.370175 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:04.370612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:04.371043 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:04.524819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:04.533949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2a4c30c4-eff9-460b-a372-d55d58a13632 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.177677 Aug 23 04:30:04.534813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 245/455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:04 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:05.095250 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:05.096791 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:05.104212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.104702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.105132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.105830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.106309 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.106736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.133254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:05.133894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:05.140871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.141586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.142175 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.143038 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.143627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.144214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.222755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.244014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-222049cd-d2e2-4fbe-b815-c54479a5682b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.107462 Aug 23 04:30:05.248922 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 246/456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:05 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:05.286741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.296110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.297638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.298829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-36d374fc-ce60-4294-a3dc-4f80130b7c94 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.207591 Aug 23 04:30:05.299393 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 211/457] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:05 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:05.328713 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:05.329401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:05.336317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.336830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.337262 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.337969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.338488 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.338905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.481493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.489390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3b82299b-7f1a-4dc3-a4c2-85f010bd04d7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.164842 Aug 23 04:30:05.490198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 247/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:05 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:05.556588 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:05.557550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:05.565359 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.565840 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.566370 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.567195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:05.567744 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:05.568197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:05.712506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:05.721576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dd57f0c2-1b46-42d8-b42b-807bcbb0c5d3 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.169901 Aug 23 04:30:05.724274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 212/459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:05 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:06.260287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:06.260877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:06.267832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.268337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.268768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.269459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.270340 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.270867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.324741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:06.325420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:06.343738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.344297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.344776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.345496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.345936 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.346387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.355841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:06.364601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-863fd3d0-f825-4d69-a169-86a2bc5ff337 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.108643 Aug 23 04:30:06.365541 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 248/460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:06 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:06.500243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:06.510195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:06.510630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:06.510804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:06.512423 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:06.514225 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dec8747e-003b-43bf-a1a1-4ffcf313e432 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.193127 Aug 23 04:30:06.517492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.518014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.518457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.519174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.519883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.520485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.529795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 213/461] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:06 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:06.745075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:06.746299 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:06.749792 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:06.760990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.761400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.761827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.762526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:06.762968 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:06.763381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:06.992796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:06.999700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:07.000868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7812fc96-aa7f-467b-8626-a13aedbf6cf8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.494604 Aug 23 04:30:07.001491 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 249/462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:06 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:07.025324 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-191f01cb-53f3-42bc-8c08-efb9460b3b7e tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.285603 Aug 23 04:30:07.026532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 214/463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:06 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:07.386050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:07.386671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:07.392862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:07.393402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:07.393833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:07.394589 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:07.395139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:07.395766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:07.463129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:07.472273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fafa80a9-9a96-4d15-890d-ef61d9aea5fc tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.090199 Aug 23 04:30:07.472905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 250/464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:07 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:07.537513 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:07.538214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:07.544775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:07.545244 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:07.545667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:07.546339 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:07.546781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:07.547191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:07.686644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:07.698053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:07.699820 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:07.700810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d4fe12e0-74f5-4431-b798-57f3599c133b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.167565 Aug 23 04:30:07.701569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 215/465] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:07 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:08.030238 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:08.030804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:08.038212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.038693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.039098 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.040120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.040631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.041145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.046677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:08.047269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:08.057614 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.058119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.058567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.059219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.059658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.060100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.275465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.279274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.284781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ed1c63df-628f-4554-878d-44c5f69817de tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.241531 Aug 23 04:30:08.298392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ab79f144-e427-4135-8485-8ec0b68501e1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.271346 Aug 23 04:30:08.299158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 216/466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:08 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:08.308233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 251/467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:08 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:08.493726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:08.494664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:08.503287 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.503795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.504316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.505141 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.505596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.506044 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.581693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.590102 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-97a8b3e0-7101-4460-8c4b-78eaa4e741bd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.100546 Aug 23 04:30:08.592053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 217/468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:08 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:08.725795 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:08.726450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:08.733286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.733763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.734194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.734918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:08.735458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:08.735797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:08.895702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.905034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.906929 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:08.908246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-13019cc0-c106-487f-a930-bcafbe0d3659 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.187016 Aug 23 04:30:08.908855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 252/469] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:08 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:09.310213 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:09.311204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:09.320367 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.320563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:09.320843 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.320991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:09.321269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.321967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.322403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.322821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.327074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.327553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.327998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.328708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.329149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.329567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.527443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:09.531477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:09.535652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dabbdda0-241d-4407-b0a7-80e3a67d9c28 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.231875 Aug 23 04:30:09.536258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 218/470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:09 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:09.539396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-17c1af75-a12a-4344-8de2-24e0c1c02e4d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.223324 Aug 23 04:30:09.540128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 253/471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:09 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:09.615089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:09.615667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:09.622773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.623286 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.623735 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.624507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.624973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.625410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.696550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:09.704522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c4b66dff-afbd-4c13-a128-171ea7d80854 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1249 microversion: 2.1 time: 0.094975 Aug 23 04:30:09.705095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 219/472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:09 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:09.936491 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:09.937503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:09.945877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.946371 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.946796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:09.947496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:09.947938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:09.948392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.089539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.102707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.104218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.105368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-22271cf6-0c49-4ebf-b087-6491f6030b00 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.175659 Aug 23 04:30:10.105921 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 254/473] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:09 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:10.557326 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:10.557943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:10.559428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:10.560326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:10.564762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.565246 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.565681 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.566376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.566702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.566853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.567192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.567332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.567632 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.568672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.569141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.569558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.761118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.764052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.769362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2ffcda04-9651-4d8b-b359-79fd6a3f69f0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.216000 Aug 23 04:30:10.769933 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 220/474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:10 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:10.772141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1e733481-35c6-4851-baf5-8292e720e15a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.216705 Aug 23 04:30:10.772708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 255/475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:10 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:10.775069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:10.775826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:10.782045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.782522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.782950 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.783629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:10.784105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:10.784524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:10.848567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:10.856673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d8895d58-4522-49f5-a17b-a58baf96f090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1241 microversion: 2.1 time: 0.085496 Aug 23 04:30:10.857233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 221/476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:10 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:11.137876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:11.138448 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:11.145231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.145711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.146709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.147399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.147842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.148280 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.283899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:11.286532 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:11.298437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:11.300822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:11.302474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-008c46b9-e896-450d-b055-04b53795374f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.168540 Aug 23 04:30:11.303051 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 256/477] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:11 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:11.790393 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:11.791177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:11.794676 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:11.795439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:11.798424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.799106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.799706 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.800460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.800877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.801288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.801630 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.802240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.803241 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.803946 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:11.804557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:11.804977 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:11.840107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=22 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:12.006819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.013416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.021659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d56975c8-54e3-4a1c-b8ea-4bc9166837e0 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1319 microversion: 2.1 time: 0.235366 Aug 23 04:30:12.035151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 222/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:11 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:12.035361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b2478a57-f850-4742-a4cf-e02b8130e8fb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.233094 Aug 23 04:30:12.035467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:12.035467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:12.035467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:12.035467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:12.036119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:12.036119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:12.036290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 257/479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:11 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:12.036363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:12.037612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:12.109576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.118101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6db0ce5e-a520-4696-8640-89a8ea5fc923 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1305 microversion: 2.1 time: 0.094517 Aug 23 04:30:12.118485 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 223/480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:12 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:12.325070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:12.326266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:12.333164 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:12.334447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:12.335086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:12.336013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:12.336633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:12.337211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:12.535185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.544815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.546485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:12.548867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3a01818b-9a52-4758-bf70-cc0772d5c46b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.227723 Aug 23 04:30:12.549515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 258/481] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:12 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:30:13.042844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:13.043424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:13.044301 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:13.044443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:13.051669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.052819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.053506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.053757 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.054334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.054850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.055363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.055905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.056079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.056522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.057093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.057657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.258101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.261955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.268086 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f0d31a38-4a01-4487-a371-d208a889df85 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1508 microversion: 2.1 time: 0.229127 Aug 23 04:30:13.268826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 224/482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:13 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:13.269871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e4c2f132-6492-414c-a64a-a414779b5f5e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.230866 Aug 23 04:30:13.270557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 259/483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:13 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:13.287037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:13.287558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:13.290017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7bffff6-1e9c-49de-9e27-a0998ae6e764", "device": "/dev/sdb"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:13.292525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:13.294167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.294659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.295069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.296015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.296458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.297033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.298708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.299187 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.299613 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.300347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.300791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.302522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.302680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:13.320210 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=100 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:13.436659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.446770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-de712abb-9731-4a2f-8be7-d29df4737442 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.176718 Aug 23 04:30:13.447657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 225/484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:13 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:13.571061 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:13.571658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:13.574001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5b56aef1-15c8-450f-94a6-573318560f35 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "POST /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288428 Aug 23 04:30:13.574878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 260/485] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:30:13 2022] POST /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:30:13.578162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.578644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.579160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.590773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.591703 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.592263 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.617627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:13.640622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.644178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.647173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.683155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] Creating event network-changed:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:30:13.688392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-426772f1-71fc-4abd-b590-1e2b60042139 req-d5c9cf24-5556-4a16-80bd-4d6f8a864bcb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075498 Aug 23 04:30:13.689234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 261/486] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:30:13.810375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.820770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.822249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:13.823398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-af2f3fa0-b4e9-476c-b840-297aa78b899c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.256323 Aug 23 04:30:13.824678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 226/487] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:13 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:30:13.911892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703", "name": "network-vif-plugged", "status": "completed", "tag": "8bf60682-c074-41e8-9a64-cd742841f206"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:13.922984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:13.923636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:13.924327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:13.937695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] Creating event network-vif-plugged:8bf60682-c074-41e8-9a64-cd742841f206 for instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 on hv-cinder-85407 Aug 23 04:30:13.942897 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-b3a25d7b-bc58-4349-b0f9-84b821aa62bf req-28ac2682-9573-48b7-b57c-6d3babb71ea1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Aug 23 04:30:13.943759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 262/488] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:14.294519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:14.295381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:14.304471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.304953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.305377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:14.306056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.306497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.306906 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:14.451332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:14.459478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d2f5082a-26a1-46f6-9ea1-a10145677456 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.171434 Aug 23 04:30:14.460077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 227/489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:14 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:14.469176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:14.469856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:14.476502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.476970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.477389 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:14.478102 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.478543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.478955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:14.611627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:14.625412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2972e749-8b65-4c82-8bd2-b776efeacb54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.160640 Aug 23 04:30:14.626284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 263/490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:14 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:14.850600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:14.851752 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:14.862030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.862773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.863543 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:14.864828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:14.865304 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:14.865722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:15.008843 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:15.017955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:15.019527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:15.020740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b75a800f-fa27-4b9e-9b6e-33675bca4198 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.177274 Aug 23 04:30:15.021413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 228/491] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:14 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:15.483208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:15.484095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:15.492869 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:15.493344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:15.493771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:15.494439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:15.494888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:15.495304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:15.633543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:15.641881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-74ae70f3-37c7-416d-b132-88af153507eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.164652 Aug 23 04:30:15.642667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 264/492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:15 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:15.655301 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:15.656177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:15.663702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:15.664353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:15.664943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:15.665763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:15.666392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:15.667289 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:15.805563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:15.813359 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1e821c2a-185a-4c21-b656-14c5325e33e0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.171645 Aug 23 04:30:15.813918 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 229/493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:15 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:30:16.045719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:16.046320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:16.052990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.053483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.053894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.054581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.055024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.055439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.198698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:16.207753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:16.209353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:16.210512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b3d279ca-6a87-4e4c-b490-0ff0367aa2f6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.168874 Aug 23 04:30:16.211068 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 265/494] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:16 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:16.666311 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:16.666964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:16.673745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.674228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.674656 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.675337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.675779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.676227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.809140 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:16.817732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ba7aa45f-26dc-42fb-8d22-bb443c21e20c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1366 microversion: 2.1 time: 0.155138 Aug 23 04:30:16.818442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 230/495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:16 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:16.834331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:16.834920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:16.841802 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.842281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.842908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.843601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:16.844078 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:16.844526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:16.984373 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:16.993487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-322c9c0e-1a7e-43a8-badf-d4ee2ce6abfd tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.163419 Aug 23 04:30:16.994069 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 266/496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:16 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:17.237895 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:17.238893 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:17.245800 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:17.246278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:17.246704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:17.247384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:17.247830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:17.248279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:17.384549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:17.393591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:17.395113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:17.396476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-249af857-d39c-4661-84f0-264e6f09478c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.165074 Aug 23 04:30:17.397083 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 231/497] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:17 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:17.838948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:17.839630 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:17.846324 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:17.846891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:17.847313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:17.848324 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:17.848775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:17.849480 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:17.919737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "name": "network-vif-plugged", "status": "completed", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:17.932148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:17.932956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:17.933920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:17.962250 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] Creating event network-vif-plugged:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:30:17.968359 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-daac7abc-da59-48d8-bd7d-8b93981b15a1 req-50477165-8575-4e5d-82af-f54226c9d112 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054189 Aug 23 04:30:17.969160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 232/498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:30:18.006270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:18.014965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c84108fe-0e07-435a-90c9-112b7910268c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1556 microversion: 2.1 time: 0.179911 Aug 23 04:30:18.015555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 267/499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:17 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:18.015770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:18.016794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:18.024048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.024522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.024945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.025624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.026064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.026501 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.036558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:18.037417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:18.047348 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.048245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.048688 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.049381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.049832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.050250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.159017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-317050fb-9f32-4837-bf1f-1cf81f6a8399 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126344 Aug 23 04:30:18.159613 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 268/500] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:30:18 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:18.210510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:18.218471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-71d88986-2b36-4fbd-858a-aaabe251bd61 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.207311 Aug 23 04:30:18.219039 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 233/501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:18 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:18.421839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:18.422463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:18.434341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.434826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.435254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.436068 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:18.436512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:18.436931 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:18.592948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:18.603329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:18.605106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:18.608014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-67ea258e-0b99-43a0-ada4-5f26b9573b95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.188683 Aug 23 04:30:18.616143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 269/502] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:18 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:19.239842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:19.240447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:19.247418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:19.247904 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:19.248367 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:19.249063 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:19.249535 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:19.249952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:19.335557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703", "tag": "8bf60682-c074-41e8-9a64-cd742841f206"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:19.342607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:19.348016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:19.348846 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:19.349544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:19.363178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] Creating event network-changed:8bf60682-c074-41e8-9a64-cd742841f206 for instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 on hv-cinder-85407 Aug 23 04:30:19.369685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-2b666bff-346c-4609-b031-3a447b649ce9 req-a73abeb7-39a8-4942-978a-71244cdf52e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Aug 23 04:30:19.370287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 270/503] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:30:19.390469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:19.398447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-05e889a2-16ab-4d72-8076-0c2447ddec5c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.162773 Aug 23 04:30:19.399208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 234/504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:19 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:19.631689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:19.632335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:19.638955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:19.639548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:19.639864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:19.640582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:19.641035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:19.641446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:19.797835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:19.813555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:19.815098 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:19.816335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-93212b8f-2caa-4fd3-9652-f7e52ee3d4ca tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.189289 Aug 23 04:30:19.816913 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 271/505] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:19 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:20.419175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:20.419726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:20.426321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:20.426799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:20.427222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:20.427884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:20.428348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:20.428757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:20.579939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:20.589207 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-73f04164-3f5b-44a3-b57e-fc9bb7d305c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1371 microversion: 2.1 time: 0.173975 Aug 23 04:30:20.590109 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 235/506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:20 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:20.840290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:20.840898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:20.847481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:20.847990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:20.848739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:20.849701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:20.850145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:20.850759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:20.989891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:20.999294 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:21.000969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:21.002264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4edf9660-1987-4717-b25e-629a5190db95 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.166175 Aug 23 04:30:21.002882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 272/507] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:20 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:21.614766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:21.615496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:21.622760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:21.623272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:21.623727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:21.624467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:21.624969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:21.625408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:21.793630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:21.803286 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-757e48e4-5f98-4027-bc6d-5c8d5ee390da tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1564 microversion: 2.1 time: 0.195089 Aug 23 04:30:21.803965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 236/508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:21 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:21.827955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:21.829572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:21.842433 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:21.843904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:21.844575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:21.845626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:21.846275 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:21.847011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:21.942785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-63b32ef2-e400-4041-9eb3-920a19443f02 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121577 Aug 23 04:30:21.943659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 273/509] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:30:21 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:21.998474 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "name": "network-vif-plugged", "status": "completed", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:22.020471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:22.021313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:22.023767 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:22.027165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:22.027727 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:22.034919 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:22.035471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:22.035988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:22.037534 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:22.038058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:22.038175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] Creating event network-vif-plugged:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:30:22.038596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:22.044590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-b5349445-ff72-4a34-95f1-f03c3e35ddf6 req-6b6b8946-a082-48bb-b4a9-67aacc61dc59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050097 Aug 23 04:30:22.045537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 237/510] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:30:22.281596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:22.295270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:22.297244 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:22.298752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7aef068a-c3aa-4df4-ac8d-56b123d20b83 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.275743 Aug 23 04:30:22.299651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 274/511] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:22 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:22.998704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:23.008900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:23.009376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:23.009803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:23.021719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] Creating event network-changed:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:30:23.026733 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-fda10beb-daa3-428e-9b50-45d397678dd9 req-c2e02593-6ce4-4e49-83d6-628f002ce3f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032483 Aug 23 04:30:23.027294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 238/512] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:23.322878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:23.324155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:23.331135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:23.331607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:23.332198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:23.333050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:23.333773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:23.334543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:23.498382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:23.508072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:23.510522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:23.512954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e10d66b7-333b-4e01-a54a-a658b02423aa tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.193775 Aug 23 04:30:23.513824 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 275/513] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:23 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:24.538510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:24.539191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:24.545567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:24.546040 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:24.546465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:24.547113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:24.547554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:24.547993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:24.679565 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:24.688444 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:24.689981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:24.691097 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-22095433-6c55-453c-87bf-c0419a0fd9b1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.157717 Aug 23 04:30:24.691654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 239/514] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:24 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:25.714858 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:25.715405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:25.722709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:25.723499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:25.724167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:25.724866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:25.725342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:25.725916 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:25.858257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:25.866917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:25.868433 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:25.869577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1d91c641-2336-4f2d-b75a-f32aba0f1499 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.158778 Aug 23 04:30:25.870129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 276/515] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:25 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:26.892635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:26.893330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:26.900645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:26.901155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:26.901617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:26.902521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:26.902973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:26.903394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:27.063329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:27.076464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:27.078775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:27.080619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0ddefeb0-44a4-434e-8f14-6cce03878d86 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.191952 Aug 23 04:30:27.081449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 240/516] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:26 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:28.106159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:28.106969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:28.113658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:28.114154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:28.114593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:28.115310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:28.115763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:28.116226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:28.253495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:28.266853 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:28.269208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:28.270991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-08792eaa-2a13-4eb5-a7c3-6c873fbe8b8c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.169451 Aug 23 04:30:28.271550 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 277/517] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:28 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:29.295714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:29.296725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:29.304457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:29.304929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:29.305351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:29.306015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:29.306479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:29.306892 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:29.447685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:29.456894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:29.459215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:29.460331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-63ae6c40-69f5-428c-83e9-37f31a39ea10 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.169177 Aug 23 04:30:29.460878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 241/518] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:29 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:30.484580 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:30.485209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:30.492189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:30.492665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:30.493088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:30.493766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:30.494211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:30.494625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:30.513779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:30.632836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:30.641897 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:30.643380 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:30.644570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-96b2d3a4-5368-4787-a3c8-c4ebdbfcd4cc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.164011 Aug 23 04:30:30.645125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 278/519] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:30 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:31.667976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:31.669162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:31.675608 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:31.676138 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:31.676570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:31.677244 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:31.677709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:31.678206 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:31.820153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:31.829272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:31.830789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:31.832013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-010b09f4-8ca0-43df-b74c-a1923efcbfc1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1810 microversion: 2.20 time: 0.168004 Aug 23 04:30:31.832619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 242/520] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:31 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:32.858667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:32.859249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:32.866563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:32.867037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:32.867464 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:32.868186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:32.868625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:32.869024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:33.013583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:33.022619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:33.024118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:33.025271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fbdd9e4f-08d0-4142-8e30-83149039970a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1797 microversion: 2.20 time: 0.172985 Aug 23 04:30:33.025846 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 279/521] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:30:32 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1797 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:30:34.232369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:34.232908 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:34.239632 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:34.240084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:34.240509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:34.241190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:34.242246 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:34.242682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:34.326415 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:34.330654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lazy-loading 'services' on Instance uuid 673892ed-32af-43be-922d-f213ecde867f {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:30:34.412046 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f2fb649d-a47e-41a2-9875-3bb33f31ded2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "DELETE /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f/os-volume_attachments/e7bffff6-1e9c-49de-9e27-a0998ae6e764" status: 202 len: 0 microversion: 2.1 time: 0.183479 Aug 23 04:30:34.412633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 243/522] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:30:34 2022] DELETE /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f/os-volume_attachments/e7bffff6-1e9c-49de-9e27-a0998ae6e764 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:30:36.616991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:36.617735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:36.624766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:36.625264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:36.625681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:36.626369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:36.626816 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:36.627236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:36.652658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:30:36.737920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d4da0a38-003c-405e-aa7f-b452c76d305c tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "DELETE /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 204 len: 0 microversion: 2.1 time: 0.127490 Aug 23 04:30:36.738415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 280/523] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:30:36 2022] DELETE /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:30:36.747460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:36.748405 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:36.756374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:36.756850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:36.757274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:36.757986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:36.758432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:36.758838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:36.892409 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:36.906118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d2985673-f5df-4a7b-a40a-1c1a7b93caae tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1514 microversion: 2.1 time: 0.163077 Aug 23 04:30:36.906816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 244/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:36 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:37.930495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:37.931149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:37.938444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:37.938928 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:37.939390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:37.940146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:37.940679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:37.941126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:38.321119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:38.329837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d809533b-0558-42ae-932f-865ae02676f2 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1514 microversion: 2.1 time: 0.404130 Aug 23 04:30:38.330410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 281/525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:37 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:39.351056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:39.351880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:39.354830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=62 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:39.360545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:39.361333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:39.361760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:39.362542 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:39.362878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:39.363293 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:39.512997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb4a476712c492da2313ef426001e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d3d5a2a0514d7687e794f8a678cff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:39.524857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a28b0f44-a701-4fae-a240-b5ff5ffdfd2f tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 200 len: 1514 microversion: 2.1 time: 0.177931 Aug 23 04:30:39.525452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 245/526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:39 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:39.652995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673892ed-32af-43be-922d-f213ecde867f", "name": "network-vif-deleted", "tag": "9c6f5b85-1738-4921-9eb1-fc2dc06098a1"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:39.664739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:39.665335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:39.665944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:39.681182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] Creating event network-vif-deleted:9c6f5b85-1738-4921-9eb1-fc2dc06098a1 for instance 673892ed-32af-43be-922d-f213ecde867f on hv-cinder-85407 Aug 23 04:30:39.687434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-30ea4ee0-c6ea-43fc-94ba-7bd6addf6566 req-4c3b4418-032e-4a98-b9b8-3d1bc509c648 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038121 Aug 23 04:30:39.688426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 282/527] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:30:40.546964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:40.547597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] [instance: 673892ed-32af-43be-922d-f213ecde867f] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:40.554925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:40.555384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:40.556096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:40.556798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:40.557234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:40.557640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:40.572444 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] HTTP exception thrown: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Request method failure captured: Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f HTTP/1.1 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFdSwjAzL3tfMap9hSS51BBzFvZ8K7xi63PJTKAd2GoJTMAXX0jzRRt42T_Ng2H-Qsjc5t3ZAgJOStFk2jFlvJkhvfQQGRKm_fBn_ytGI8aB1akENcr6xQ2sSvwDa2o5Z6Fl4omflEbhPMz39Hp71hBNsYBXJ59dg-6Nm0XfllZ-h5Y Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 57d3d5a2a0514d7687e794f8a678cff9 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:30:40.574167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_57d3d5a2a0514d7687e794f8a678cff9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/57d3d5a2a0514d7687e794f8a678cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 57d3d5a2a0514d7687e794f8a678cff9 Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-855161699 Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesSnapshotTestJSON-855161699-project Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 4eb4a476712c492da2313ef426001e33 Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesSnapshotTestJSON-855161699-project Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. Aug 23 04:30:40.575596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '673892ed-32af-43be-922d-f213ecde867f'} Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:30:40.576567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. Aug 23 04:30:40.578017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:30:40.579136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] Returning 404 to user: Instance 673892ed-32af-43be-922d-f213ecde867f could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:30:40.579136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2a44a6cc-436b-4524-9a92-9ddd83601374 tempest-VolumesSnapshotTestJSON-855161699 tempest-VolumesSnapshotTestJSON-855161699-project] 10.222.0.18 "GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f" status: 404 len: 111 microversion: 2.1 time: 0.032793 Aug 23 04:30:40.579136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 246/528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:40 2022] GET /compute/v2.1/servers/673892ed-32af-43be-922d-f213ecde867f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:30:50.149195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:50.149944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:50.156855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:50.157798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:50.169990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:50.170566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:50.170876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:50.171560 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:50.172030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:50.172441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:50.303904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'services' on Instance uuid d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:30:50.434403 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d228cd42-db69-4497-982b-5a4f85219f38 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments/1c987f61-50b5-4480-b595-92ebc4b0b178" status: 202 len: 0 microversion: 2.1 time: 0.288196 Aug 23 04:30:50.435319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 283/529] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:30:50 2022] DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments/1c987f61-50b5-4480-b595-92ebc4b0b178 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:30:54.751833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:30:54.754558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:54.755200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:54.761070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:54.761561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:54.761990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:54.784979 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Going to try to stop instance {{(pid=121224) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 04:30:54.838069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dffa75ab-1369-4dd9-8093-cb67f5925c3d tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action" status: 202 len: 0 microversion: 2.1 time: 0.089839 Aug 23 04:30:54.838841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 247/530] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:30:54 2022] POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:30:54.854177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:54.855723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:54.862532 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:54.863064 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:54.863512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:54.864224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:54.864665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:54.865071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:55.005111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:55.013052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-54ae2d6e-a09d-48bd-be90-2d3475622ab4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.169670 Aug 23 04:30:55.013591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 284/531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:54 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:56.035778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:56.036684 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:56.042866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:56.043378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:56.043810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:56.044524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:56.044966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:56.045418 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:56.182371 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:56.190698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bdd9ef66-33ed-4994-9c3a-977cf9fcb6d9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.159688 Aug 23 04:30:56.191230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 248/532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:56 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:57.218501 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:57.219109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:57.226083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:57.226566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:57.226983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:57.227664 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:57.228137 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:57.228556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:57.363146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:57.371109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2d996840-4840-4c40-92f6-f0f12398ee21 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.156469 Aug 23 04:30:57.371687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 285/533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:57 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:58.392887 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:58.393504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:58.399549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:58.400076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:58.400512 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:58.401196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:58.401648 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:58.402068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:58.537121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:58.544757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-952eb902-453c-4906-ba5c-8da23d27c6f1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.156034 Aug 23 04:30:58.545329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 249/534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:58 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:30:59.570441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:30:59.573376 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:30:59.581003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:59.581540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:59.582146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:59.583117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:30:59.583515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:30:59.583955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:30:59.719617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:30:59.727941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9817fb8f-fef3-4e13-acf0-cad61f60d3dc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.163455 Aug 23 04:30:59.728520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 286/535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:30:59 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:00.753287 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:00.754095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:00.761046 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:00.761506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:00.761930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:00.762606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:00.763032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:00.763453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:00.896933 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:00.905155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d21f8f09-8775-47fb-8394-4f16652a4122 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.158395 Aug 23 04:31:00.905722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 250/536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:00 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:01.932595 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:01.933226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:01.940016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:01.940473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:01.941093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:01.941746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:01.942994 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:01.943410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:02.080309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:02.088405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e6628ac7-e4ea-4493-8ac0-06e7e413df70 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.159806 Aug 23 04:31:02.088964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 287/537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:01 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:03.111389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:03.112010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:03.119215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:03.119695 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:03.120147 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:03.120832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:03.121279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:03.121703 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:03.268726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:03.277671 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-26739f9e-fd1f-4056-ae3b-6a224b92fb5f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.170020 Aug 23 04:31:03.278711 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 251/538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:03 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:04.298768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:04.299406 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:04.305895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:04.306389 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:04.306810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:04.307529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:04.307973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:04.308498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:04.479118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:04.486849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-dd009191-8813-4674-a87c-0ec0909f1936 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1678 microversion: 2.1 time: 0.191947 Aug 23 04:31:04.487414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 288/539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:04 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:05.508863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:05.509465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:05.516335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:05.516825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:05.517229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:05.517913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:05.518349 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:05.518758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:05.657826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:05.666581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-71bbba60-c0df-4f92-b753-7c80f803bbb0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1655 microversion: 2.1 time: 0.161845 Aug 23 04:31:05.667222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 252/540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:05 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:05.688937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:05.696705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:05.697194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:05.697626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:05.720120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Going to try to start instance {{(pid=121223) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 04:31:05.764408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5ad50f01-a051-4d60-9346-2d04af4deab7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action" status: 202 len: 0 microversion: 2.1 time: 0.079488 Aug 23 04:31:05.765227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 289/541] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:31:05 2022] POST /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:31:05.774384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:05.775091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:05.781505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:05.781992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:05.782568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:05.783305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:05.783704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:05.784141 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:05.926242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:05.935470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-80990570-3cef-4ce2-91dd-3136fa88c02f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1664 microversion: 2.1 time: 0.165765 Aug 23 04:31:05.936075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 253/542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:05 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:31:06.961212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:06.962070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:06.971750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:06.972381 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:06.972967 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:06.974396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:06.974955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:06.975470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:07.119387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:07.127738 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-240794a8-8a31-4663-8f21-b8f2203f30f7 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1664 microversion: 2.1 time: 0.173144 Aug 23 04:31:07.128340 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 290/543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:06 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:08.150115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:08.150756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:08.157931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:08.158449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:08.158938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:08.159659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:08.160183 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:08.160640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:08.306623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:08.315109 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-52d96741-8de7-472f-bf97-31e1c61b6aa3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1668 microversion: 2.1 time: 0.169253 Aug 23 04:31:08.315704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 254/544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:08 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:09.529871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "461d4e4f-b10d-4e0c-b8ae-11a6963a7083"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:09.532316 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:09.539241 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:09.539707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:09.540185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:09.540882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:09.541309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:09.541725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:10.421680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ec49e32c-a73b-4ad4-9bc3-ddc813a432c7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895824 Aug 23 04:31:10.422525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 291/545] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:31:09 2022] POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:15.076300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:15.076797 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:15.083827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.084362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.084777 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.085458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.085907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.086325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.110202 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-67a20974-84b2-465f-931d-6b58f74efe1c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/ips" status: 200 len: 150 microversion: 2.1 time: 0.037857 Aug 23 04:31:15.110767 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 255/546] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:31:15 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:15.126294 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51f9df85-b68d-452a-bd70-471ba7569ab3"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:15.128753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:15.135770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.136273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.136694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.137370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.137867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.138242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.236618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: POST /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/os-volume_attachments HTTP/1.1 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 74 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:31:15.239457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {"volumeAttachment": {"volumeId": "51f9df85-b68d-452a-bd70-471ba7569ab3"}} Aug 23 04:31:15.241107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'server_id': '3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703', 'body': {'volumeAttachment': {'volumeId': '51f9df85-b68d-452a-bd70-471ba7569ab3'}}} Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:15.242061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:15.243445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 400 to user: Invalid volume: volume 51f9df85-b68d-452a-bd70-471ba7569ab3 is already attached to instances: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d4058cb4-7518-45b2-bbba-488307c6290c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122731 Aug 23 04:31:15.244843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 292/547] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:31:15 2022] POST /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:31:15.250382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:15.250880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:15.257854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.258339 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.258772 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.259446 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.259898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.260344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.286310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:31:15.372433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3cdd9993-1dfe-4636-8c16-145476f75c0b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 204 len: 0 microversion: 2.1 time: 0.125672 Aug 23 04:31:15.373069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 256/548] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:31:15 2022] DELETE /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:31:15.382401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:15.382995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:15.392238 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.392699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.393119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.393885 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:15.394322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:15.394836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:15.534620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:15.543234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-58edd6ce-8f08-4fda-aab7-d4eea8f9af50 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1681 microversion: 2.1 time: 0.164702 Aug 23 04:31:15.543721 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 293/549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:15 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:16.569389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:16.570162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:16.577844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:16.578379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:16.578856 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:16.579607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:16.580161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:16.580673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:16.723321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:16.731972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ba825e48-a6f6-4739-8e0d-7130181d308b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1681 microversion: 2.1 time: 0.168563 Aug 23 04:31:16.732531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 257/550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:16 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:17.756320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:17.757004 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:17.763835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:17.764338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:17.765036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:17.765718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:17.766162 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:17.766566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:17.907250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:17.915398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-57ba2878-6f9f-4532-a746-76ce89a1185c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1681 microversion: 2.1 time: 0.164541 Aug 23 04:31:17.916209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 294/551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:17 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:18.939409 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:18.940273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:18.949667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:18.950330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:18.953469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:18.954410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:18.955024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:18.955594 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:19.106011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:19.117590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-acb50cfa-2253-4b2b-8292-f3e4d01d7c1f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1681 microversion: 2.1 time: 0.183403 Aug 23 04:31:19.118189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 258/552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:18 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:20.139518 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:20.140227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:20.147295 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:20.147826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:20.148323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:20.149122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:20.149637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:20.150071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:20.315170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:20.325559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:20.328946 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2d8523bb-e7fc-4d64-be4f-990d0dcc4af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1681 microversion: 2.1 time: 0.193604 Aug 23 04:31:20.329711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 295/553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:20 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:21.218071 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:21.218534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.221895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:21.226908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.232008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.233020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.233796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.234270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=27 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:21.236336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.237201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.237824 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.238249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.239892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.240473 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.241043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.241437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.242260 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.277830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-149f909a-bc25-4023-a579-65af3b1f3d12 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments/a6e83de2-082a-4c01-bd00-451f2d5ece6c" status: 200 len: 194 microversion: 2.20 time: 0.065026 Aug 23 04:31:21.278426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 259/554] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Aug 23 04:31:21 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments/a6e83de2-082a-4c01-bd00-451f2d5ece6c => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:31:21.284452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'flavor' on Instance uuid 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:21.300070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703", "name": "network-vif-deleted", "tag": "8bf60682-c074-41e8-9a64-cd742841f206"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:21.320467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.321450 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.322430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.337573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] Creating event network-vif-deleted:8bf60682-c074-41e8-9a64-cd742841f206 for instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 on hv-cinder-85407 Aug 23 04:31:21.346710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-99380342-c669-40ef-8040-9630b1a3d7ba req-f9d42c49-2795-406f-b2cc-87e43b7c61d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066756 Aug 23 04:31:21.347870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 260/555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:21.359070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:21.361381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.370076 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.370844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.371510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.372451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.373145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.374043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.411964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.412863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.413443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.413907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lazy-loading 'fault' on Instance uuid 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:21.420291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:21.444972 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-20f6fc97-eb8d-45ba-85b1-28aadc35760b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/action" status: 200 len: 32 microversion: 2.1 time: 0.228366 Aug 23 04:31:21.449877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 296/556] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:31:21 2022] POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 04:31:21.465139 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:21.465735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.472450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.473254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.474009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.474993 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.475444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.475877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.480334 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:21.491488 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ddb94c26-071c-4720-9499-ed5e4702f528 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 200 len: 1331 microversion: 2.1 time: 0.141309 Aug 23 04:31:21.492425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 261/557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:21 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:21.497172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:21.498014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.504205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.505233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.505937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.506844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.507494 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.508143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.600040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lazy-loading 'services' on Instance uuid c0da9656-e0b8-4a68-9062-f3abc68d75f8 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:21.653984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:21.663232 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-282d2d1f-be95-4407-85aa-ac4b6d5f5f32 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.169379 Aug 23 04:31:21.663773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 262/558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:21 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:21.701867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d754ba0c-bd57-4108-9d92-712c91bf4826 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments/a6e83de2-082a-4c01-bd00-451f2d5ece6c" status: 202 len: 0 microversion: 2.20 time: 0.253304 Aug 23 04:31:21.702659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 297/559] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Aug 23 04:31:21 2022] DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments/a6e83de2-082a-4c01-bd00-451f2d5ece6c => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:31:21.712052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:21.714529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:21.721703 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.722640 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.723335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.724661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:21.725307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:21.725920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:21.775680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f514ae80-a6c8-44bc-85d0-930a7f0c7cef tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068078 Aug 23 04:31:21.777045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 263/560] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Aug 23 04:31:21 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 04:31:22.514080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:22.517569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:22.533841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.534583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.535011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.535826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.538098 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.538522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.560437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 HTTP/1.1 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:31:22.562422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:31:22.563781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703'} Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:22.564552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:31:22.565645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:22.569034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:22.570607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-755b17a3-73b0-4a5b-97c3-ae7a66a18da9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 404 len: 111 microversion: 2.1 time: 0.061602 Aug 23 04:31:22.571765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 298/561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:22 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:31:22.582025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c1842d99-019a-49b1-9d81-5ff2418ccf0a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '.version_select at 0x7f9c1c296ca0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:22.625920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c1842d99-019a-49b1-9d81-5ff2418ccf0a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078470877" status: 202 len: 0 microversion: 2.1 time: 0.048678 Aug 23 04:31:22.627860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 264/562] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Aug 23 04:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078470877 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:31:22.685615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:22.686224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:22.694679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.695161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.695590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.696310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.696749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.698253 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.791260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:22.793499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:22.801174 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.802511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.803367 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.804347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.805382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.806300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.841621 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c616a273-4b23-48e2-af15-7bef41dd23b9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054899 Aug 23 04:31:22.842303 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 265/563] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Aug 23 04:31:22 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:22.912477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:22.922368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1d31e4ae-ee9c-4c39-a626-0ac499e768c4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.241493 Aug 23 04:31:22.924938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 299/564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:22 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:22.928893 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:22.929722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:22.937064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.937831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.939012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.940484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:22.941125 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:22.941544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:22.969619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:31:23.072021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-112493a2-3260-43f5-bb5f-667a6077cbb1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 204 len: 0 microversion: 2.20 time: 0.153440 Aug 23 04:31:23.076615 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 266/565] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Aug 23 04:31:22 2022] DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 04:31:23.082683 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:23.083726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:23.090590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.091062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.091659 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.092567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.093175 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.093736 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.312718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:23.321754 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:23.323249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:23.333708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cc85db41-d489-4dbd-864b-43c52576c178 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.248954 Aug 23 04:31:23.334330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 300/566] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:23 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:23.568772 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:23.569344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:23.575866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.576391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.576831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.577568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.578014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.578427 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.667247 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lazy-loading 'services' on Instance uuid e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:23.741230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6ba9f813-fbcc-4554-9b49-36d4ee9ee168 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments/51f9df85-b68d-452a-bd70-471ba7569ab3" status: 202 len: 0 microversion: 2.1 time: 0.176905 Aug 23 04:31:23.741819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 267/567] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:31:23 2022] DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments/51f9df85-b68d-452a-bd70-471ba7569ab3 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:31:23.750287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:23.752504 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:23.759247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.759722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.760171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.760861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.761304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.761715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.791100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7b752b4e-a579-4a23-acf0-3999556e9c81 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Aug 23 04:31:23.791625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 301/568] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:31:23 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:23.950671 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:23.951830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:23.962343 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.963142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.963906 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:23.965062 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:23.965812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:23.966515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:24.121687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:24.131275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8deacd7a-4402-4a57-8dfd-add2de93e366 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.187665 Aug 23 04:31:24.131842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 268/569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:23 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:24.361496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:24.362338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:24.369375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:24.369890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:24.370322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:24.371042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:24.371633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:24.372118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:24.533023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:24.543247 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:24.544784 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:24.545970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9fd3bec5-3f21-4a4e-8f4f-0550986b71cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.191166 Aug 23 04:31:24.546526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 302/570] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:24 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:24.806454 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:24.808963 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:24.811642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:24.817686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:24.818172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:24.818600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:24.819279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:24.819785 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:24.820177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:24.853826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-84441016-06cc-4d16-9e7d-f1ef77cec4ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051564 Aug 23 04:31:24.854337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 269/571] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:31:24 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:25.155617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:25.156283 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:25.165454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.165930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.166360 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.167073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.167513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.167935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.318705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:25.327792 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e9b538fb-77f9-4e7d-b158-739388ff34df tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.176008 Aug 23 04:31:25.345267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 303/572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:25 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:25.571861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:25.572624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:25.579465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.580100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.580591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.581353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.581807 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.582252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.741955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:25.752673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:25.754675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:25.755612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6a470b59-0f2c-4117-b965-1763f7418508 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1725 microversion: 2.20 time: 0.188276 Aug 23 04:31:25.756213 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 270/573] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:25 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:25.866383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:25.868614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:25.874936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.875412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.875831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.876546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.876982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.877388 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.906549 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f4106535-9892-480b-9357-78c1b265f30b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044345 Aug 23 04:31:25.907122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 304/574] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:31:25 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:31:25.970265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:25.970796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:25.977421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.977902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.978331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:25.979014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:25.979463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:25.979881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.006116 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:31:26.097095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3d22770e-90a1-41ba-90c0-ce2542041380 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 204 len: 0 microversion: 2.1 time: 0.130145 Aug 23 04:31:26.097682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 271/575] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:31:25 2022] DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:31:26.106271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:26.106868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:26.112871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.113333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.113809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.114560 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.114997 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.115414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.247899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:26.256110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0690da0a-dd0f-437b-8877-d138ab09772a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1678 microversion: 2.1 time: 0.153568 Aug 23 04:31:26.256838 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 305/576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:26 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:26.331760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0da9656-e0b8-4a68-9062-f3abc68d75f8", "name": "network-vif-deleted", "tag": "56285f49-e5c0-4e47-acbc-7a0f3d0d8622"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:26.341217 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.341689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.342093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.353833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] Creating event network-vif-deleted:56285f49-e5c0-4e47-acbc-7a0f3d0d8622 for instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 on hv-cinder-85407 Aug 23 04:31:26.355218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:26.355934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:26.358770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-af658827-d11e-445f-a735-d6c9b617c190 req-a2ae53aa-d904-467a-aad8-28979682c109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Aug 23 04:31:26.359357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 272/577] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:26.364067 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.364654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.364990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.365698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.366141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.366562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.509088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:26.517736 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0c2731e0-39d2-4307-9dad-3b0c269579d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.166619 Aug 23 04:31:26.518723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 306/578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:26 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:31:26.779561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:26.780187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:26.787068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.787537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.787948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.788668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:26.789104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:26.789511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:26.853680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:26.861788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:26.863256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:26.864799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9a4aa0b9-9b7a-4cf4-9028-d712909790f8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1657 microversion: 2.20 time: 0.089642 Aug 23 04:31:26.865352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 273/579] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:26 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:27.278271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:27.278832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:27.285771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.286532 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.286686 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.287390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.287836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.288304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.429175 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:27.437858 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a3f50d51-f034-412b-b199-f8f04dc077a8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1678 microversion: 2.1 time: 0.163547 Aug 23 04:31:27.438424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 307/580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:27 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:27.540401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:27.541057 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:27.548692 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.549229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.549794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.550498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.551027 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.551539 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.687090 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:27.695557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d2270f7e-b560-400c-9417-d34f7a65253a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.160252 Aug 23 04:31:27.696137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 274/581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:27 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:27.890417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:27.891499 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:27.899958 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.907152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.908007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.908931 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.910103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.910854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.949448 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:27.950389 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:27.951149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:27.951735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lazy-loading 'fault' on Instance uuid c0da9656-e0b8-4a68-9062-f3abc68d75f8 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:28.029363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:28.037052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:28.038719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:28.040117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9a4cce18-9473-46e2-91f0-26622f8ac3e1 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 200 len: 1371 microversion: 2.20 time: 0.154691 Aug 23 04:31:28.040822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 308/582] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:27 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:28.460297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:28.460944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:28.468456 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:28.468980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:28.469400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:28.470113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:28.470549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:28.470962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:28.604033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:28.607711 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:28.613387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c47729c5-761a-4818-9896-cd5a7a19b8e0 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1678 microversion: 2.1 time: 0.157016 Aug 23 04:31:28.614171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 275/583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:28 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:28.717194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:28.717745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:28.724768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:28.725377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:28.725809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:28.726501 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:28.726950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:28.727372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:28.880524 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:28.889249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-43ae942c-2db0-4d7e-a403-d2f32d481df0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.176091 Aug 23 04:31:28.889814 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 309/584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:28 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:29.068186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:29.071986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:29.077594 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.080696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.081159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.081890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.082353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.082781 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.100788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 HTTP/1.1 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:31:29.102467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:31:29.104074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'c0da9656-e0b8-4a68-9062-f3abc68d75f8'} Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:29.104970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:31:29.106425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:29.107638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:29.107638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-348ae372-7fb4-46db-9ddd-cfaa291b51a7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 404 len: 111 microversion: 2.20 time: 0.042378 Aug 23 04:31:29.113086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c103111f-615f-4897-9424-03a6877ad488 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '.version_select at 0x7f9c16f540d0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:29.116079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 276/585] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:29 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:31:29.135409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c103111f-615f-4897-9424-03a6877ad488 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578915449" status: 204 len: 0 microversion: 2.20 time: 0.026134 Aug 23 04:31:29.138123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 310/586] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Aug 23 04:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578915449 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 04:31:29.141527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a", "name": "network-vif-deleted", "tag": "ffed3c3d-2c51-45e4-bdfc-8a410e33cff3"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:29.154018 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.154837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.157009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.184188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] Creating event network-vif-deleted:ffed3c3d-2c51-45e4-bdfc-8a410e33cff3 for instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a on hv-cinder-85407 Aug 23 04:31:29.204135 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-fd34e401-0adb-4294-bc0e-aa031debf361 req-cf50c0ac-9412-4588-a587-fd90fc59fa7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065079 Aug 23 04:31:29.205231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 277/587] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:29.639634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:29.641066 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:29.649959 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.650726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.651549 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.652346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.653178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.661478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.678553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:29.726546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.727245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.727575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.728226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lazy-loading 'fault' on Instance uuid e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:29.798681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:29.808443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-8ccad30d-2de4-494d-b4db-47e349ce17ba tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 200 len: 1331 microversion: 2.1 time: 0.176970 Aug 23 04:31:29.809455 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 311/588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:29 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:29.912622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:29.914198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:29.924341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.924879 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.925531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.926211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:29.926784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:29.927420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:29.951730 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a9255337-e0c9-4cbe-9f35-e13a91f3a83d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: .version_select at 0x7f9c16fe1dc0>, body: {"keypair": {"name": "tempest-keypair-1247280138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/0eLvawB9DviHMUPoqweJ6fj/pRu0NBXHW7IL/gctMV0mK9hoAwvYOOzyUoHzxTuIx9zjjtPdlzFvwjBi6IDuYBsn++m8DJJFzAVkw7iI7YYf8Tv/PmV1lGlXnxT2hNA=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:29.971261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-a9255337-e0c9-4cbe-9f35-e13a91f3a83d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for project fa6589185abe4af1b3d0cba6f0699538. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:29.976572 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-a9255337-e0c9-4cbe-9f35-e13a91f3a83d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for user c8fa0859e5c14c53a5a2473c95efe152 and project fa6589185abe4af1b3d0cba6f0699538. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:30.008697 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a9255337-e0c9-4cbe-9f35-e13a91f3a83d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060880 Aug 23 04:31:30.009516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 312/589] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Aug 23 04:31:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 04:31:30.166627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:30.176910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-194bc863-973a-4656-8998-208c15e296a6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.269274 Aug 23 04:31:30.192333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 278/590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:29 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:30.830887 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:30.831473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:30.837937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:30.838416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:30.838841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:30.839529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:30.840000 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:30.840418 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:30.854384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a HTTP/1.1 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:31:30.855934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:31:30.857290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a'} Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:30.858154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:31:30.859211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:30.860329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:30.860329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-88fc00e2-8348-4bf2-b7a1-3e68045f5e38 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 404 len: 111 microversion: 2.1 time: 0.030897 Aug 23 04:31:30.860329 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 313/591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:30 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:31:30.866747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-80537b5a-e04b-4659-be6f-72ffd62aec66 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '.version_select at 0x7f9c16f365e0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:30.886356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-80537b5a-e04b-4659-be6f-72ffd62aec66 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475356655" status: 202 len: 0 microversion: 2.1 time: 0.023810 Aug 23 04:31:30.887242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 279/592] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Aug 23 04:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475356655 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:31:31.201881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:31.202735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:31.212839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:31.213618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:31.214067 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:31.214949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:31.215605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:31.216054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:31.436417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:31.445407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d0ed2b15-a906-47ed-b8cb-8afd09135604 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.247890 Aug 23 04:31:31.459831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 314/593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:31 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:31.531981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-349261551", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6add0727-6c98-4d08-a7e7-3e117fdd2353"}], "security_groups": [{"name": "tempest-securitygroup--758709695"}], "key_name": "tempest-keypair-1247280138", "user_data": "}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:31.565450 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-da3754a5-3a3d-4d6b-95e2-32660569e8ca tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: .version_select at 0x7f9c16fd5280>, body: {"keypair": {"name": "tempest-keypair-1309381846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqWGUDCmBMzTpQDoMaP25BYD7MaI5boiHjTdz/1lKdVNhd6V9IfgxT7OJKhrIr2l1078zb0IprkIFDFbjUMVCLaia6K9Pwh2BN0vSEN1h0ZCaHao74QdCJxJ90xSf2cGg=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:31.583593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-da3754a5-3a3d-4d6b-95e2-32660569e8ca tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:31.587446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-da3754a5-3a3d-4d6b-95e2-32660569e8ca tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:31.609752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-da3754a5-3a3d-4d6b-95e2-32660569e8ca tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048201 Aug 23 04:31:31.610336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 315/594] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:31:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:31:31.641105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] validate_networks() for [('6add0727-6c98-4d08-a7e7-3e117fdd2353', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:31:32.103404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:31:32.103404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:31:32.103596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:31:32.104162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:31:32.104573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:31:32.113841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:32.114335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:32.114783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:32.115481 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:32.116112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:32.116553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:32.134102 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for project fa6589185abe4af1b3d0cba6f0699538. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:32.138164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Getting quotas for user c8fa0859e5c14c53a5a2473c95efe152 and project fa6589185abe4af1b3d0cba6f0699538. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:32.149336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:31:32.151691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:31:32.206677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4910342d-2536-4017-9d63-e6806bc60d5b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.679217 Aug 23 04:31:32.207783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 280/595] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Aug 23 04:31:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 04:31:32.219340 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:32.220117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:32.294966 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:32.303065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:32.305205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:32.306282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f9a7fd86-8055-47ff-affb-c29c4e9de5ce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1281 microversion: 2.20 time: 0.091990 Aug 23 04:31:32.306989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 316/596] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:32 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:31:32.468651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:32.469922 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:32.479760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:32.480367 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:32.481096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:32.481903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:32.482459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:32.483196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:32.633683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:32.642329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-aab90f1a-cc7e-4985-9dd0-470c09368e7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.179442 Aug 23 04:31:32.643238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 281/597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:32 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:33.305746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-158608360", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c6be732-b40b-47aa-8b96-da7512121793"}], "security_groups": [{"name": "tempest-securitygroup--830336987"}], "key_name": "tempest-keypair-1309381846", "user_data": "}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:33.332901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:33.333855 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:33.342156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.342683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.343108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.344059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.344532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.344921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.432341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:33.442874 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:33.448295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:33.449839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4f6c9ae4-5ae8-4f64-9361-50049be30ee6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1351 microversion: 2.20 time: 0.121446 Aug 23 04:31:33.455297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 282/598] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:33 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:33.469988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] validate_networks() for [('8c6be732-b40b-47aa-8b96-da7512121793', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:31:33.664784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:33.665725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:33.684518 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.685275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.685743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.686451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.686902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.690387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.900449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:33.909516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-92b9d44e-0099-4974-83f1-f8d8808cc5db tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.249045 Aug 23 04:31:33.910139 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 283/599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:33 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:31:33.927815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:31:33.928398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:31:33.928981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:31:33.929409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:31:33.929970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:31:33.939725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.940186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.940675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.941447 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:33.941954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:33.942370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:33.959616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:33.963835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:33.977503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:31:33.979989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:31:34.029382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b1ea12c3-bf8e-4d40-9cdb-9e05564a1785 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.730031 Aug 23 04:31:34.035809 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 317/600] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:31:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:31:34.041827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2941b10f-27df-4dc9-a319-4bd859f00495 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:34.042759 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2941b10f-27df-4dc9-a319-4bd859f00495 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:34.134746 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2941b10f-27df-4dc9-a319-4bd859f00495 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:34.148235 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2941b10f-27df-4dc9-a319-4bd859f00495 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1241 microversion: 2.1 time: 0.109550 Aug 23 04:31:34.149720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 284/601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:34 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:34.474993 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:34.475719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:34.482307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:34.482875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:34.483176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:34.483854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:34.484317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:34.484888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:34.636113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:34.645815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:34.647571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:34.648728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-220c47f5-ea37-470a-baa1-d8e7211e98d0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.178666 Aug 23 04:31:34.663292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 318/602] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:34 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:34.799010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:34.810646 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:34.811331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:34.811827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:34.824482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] Creating event network-changed:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:31:34.831058 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-2ba3926a-57d8-4cbc-b013-67683a92c99e req-aa8c412f-d95b-4d4f-908f-34b51bee4f47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038053 Aug 23 04:31:34.832210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 285/603] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:34.932453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:34.933059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:34.939220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:34.939694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:34.940148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:34.940819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:34.941256 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:34.941662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:35.089388 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:35.098111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a24098fb-5eb1-456c-9ba4-9b3a0020340a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.169932 Aug 23 04:31:35.099399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 319/604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:34 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:35.174846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:35.175587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:35.183381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:35.183858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:35.184323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:35.185011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:35.185449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:35.185949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:35.256653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:35.266624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a7cd129f-113e-4d67-b9fb-340817a20a67 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1301 microversion: 2.1 time: 0.096929 Aug 23 04:31:35.267390 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 286/605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:35 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:35.671104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:35.671711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:35.679793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:35.680290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:35.680705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:35.681385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:35.681823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:35.682224 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:35.815778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:35.824505 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:35.826013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:35.827125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2bd101a5-1c78-409c-9ab4-ff26a2e92531 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.160250 Aug 23 04:31:35.827684 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 320/606] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:35 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:36.120960 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:36.121639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:36.128335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.128702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.129127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.129819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.130265 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.130680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.268990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:36.277959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d0587770-666c-40d7-b614-b24995b6956f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.161129 Aug 23 04:31:36.278557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 287/607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:36 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:36.288799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:36.289740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:36.296574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.297121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.297554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.298246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.298693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.299111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.665578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:36.673761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fa18c967-b79e-4e81-b3a6-54056f2d496a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.388940 Aug 23 04:31:36.674647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 321/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:36 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:36.849736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:36.850452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:36.856953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.857430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.857849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.858515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:36.859000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:36.859420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:36.989604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:36.998084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:36.999581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:37.000852 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-86ecaeb6-da87-4499-9b52-d9f836a032ab tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.155471 Aug 23 04:31:37.001434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 288/609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:36 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:37.302906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:37.303579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:37.309715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:37.310193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:37.310655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:37.311326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:37.311771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:37.312231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:37.403796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c52f9ce-e7c8-4f79-a87f-ce45dadb8579", "tag": "f755fe0e-1a8d-487d-83d5-4a229002245d"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:37.416652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:37.418284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:37.418720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:37.433072 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] Creating event network-changed:f755fe0e-1a8d-487d-83d5-4a229002245d for instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 on hv-cinder-85407 Aug 23 04:31:37.438107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-7eb4d396-3f72-49cd-a1ba-6223aec2e2ed req-e9ec1f06-722a-4f5b-9948-588c1c079752 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039944 Aug 23 04:31:37.438941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 289/610] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:37.469042 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:37.478503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e10ff3e7-db2a-4fdb-83c0-8417f1611df4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.182685 Aug 23 04:31:37.479071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 322/611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:37 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:37.695496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:37.696222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:37.702745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:37.703217 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:37.703646 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:37.704353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:37.704792 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:37.705431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:37.839675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:37.849616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-462b76ce-666b-4225-87df-fcf83ab11c5c tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.158477 Aug 23 04:31:37.850477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 290/612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:37 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:38.022923 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:38.023579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:38.029957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.030428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.030849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:38.031526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.031959 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.032399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:38.169443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:38.177709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:38.179192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:38.180336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2159c33f-08ce-4ed6-8e38-81542f1caeea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.161486 Aug 23 04:31:38.180986 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 323/613] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:38 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:38.500503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:38.501093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:38.509934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.510428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.510858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:38.511561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.512069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.512452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:38.643211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:38.652030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f07f64e0-6230-4abd-a6da-a069e79948f2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.155388 Aug 23 04:31:38.652621 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 291/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:38 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:38.874873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:38.875850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:38.879437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:38.886355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.886829 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.887252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:38.887943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:38.888391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:38.888806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:39.031694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:39.039752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-aa591c7a-3c29-4b19-976d-929590e35af7 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.171268 Aug 23 04:31:39.040342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 324/615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:38 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:39.206866 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:39.207849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:39.215089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:39.215588 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:39.216133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:39.216841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:39.217313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:39.217755 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:39.367966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:39.376792 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:39.378298 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:39.379447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4edb22b8-5351-4947-b1bc-86dae057e44c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.179335 Aug 23 04:31:39.380004 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 292/616] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:39 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:39.677268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:39.678611 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:39.689319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:39.690105 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:39.690813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:39.691955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:39.692719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:39.693702 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:39.827044 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:39.837679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9953bb36-e500-4191-8efe-08fc215f0bd5 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.166951 Aug 23 04:31:39.838237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 325/617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:39 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:40.060821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:40.061721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:40.069493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.069739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.069970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.070882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.071509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.072253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.229056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:40.237585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e74b0e9d-7677-4a82-8a8e-91b6fd55f027 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.180609 Aug 23 04:31:40.251945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 293/618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:40 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:40.353158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "name": "network-vif-plugged", "status": "completed", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:40.363305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.363758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.364526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.377881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] Creating event network-vif-plugged:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:31:40.384285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-cea4785b-0e79-4ac4-979c-fdb2293a9e51 req-23561c40-1fa8-4daa-9a76-e4d55266d495 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035386 Aug 23 04:31:40.385051 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 326/619] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:40.402593 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:40.403188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:40.409281 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.409760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.410187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.411162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.411612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.412056 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.551011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:40.560586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:40.562075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:40.563162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e7614a6a-9025-4adf-a038-46e85672064c tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.164963 Aug 23 04:31:40.564156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 294/620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:40 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:31:40.863613 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:40.864777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:40.871884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.872386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.872811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:40.873498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:40.873935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:40.874341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:41.013934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:41.027022 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cdd17990-7223-4518-8787-0ad4b7117a44 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1735 microversion: 2.1 time: 0.170214 Aug 23 04:31:41.027855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 327/621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:40 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:41.265663 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:41.266523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:41.277986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:41.278810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:41.279556 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:41.280803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:41.281601 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:41.282308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:41.423417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:41.432527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fcbc1ce8-cbff-41e1-ac50-e3445431f078 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.173235 Aug 23 04:31:41.435446 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 295/622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:41 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:41.587649 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:41.588944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:41.595739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:41.596248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:41.596672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:41.597518 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:41.597960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:41.598375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:41.729005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:41.741793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:41.743961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:41.745379 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9bf375bd-da81-406a-9ebd-8ebe0fe21b7a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.162354 Aug 23 04:31:41.746135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 328/623] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:41 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:42.056160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:42.057164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.067129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.067981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.068865 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.069920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.070377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.070796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.124810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:42.204193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.212874 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b04d9ca4-ae95-4678-a306-55a80854456a tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1715 microversion: 2.1 time: 0.163261 Aug 23 04:31:42.213601 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 296/624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:42 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:42.324484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:42.324990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.331385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.331880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.332347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.333049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.333498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.333912 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.409115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c52f9ce-e7c8-4f79-a87f-ce45dadb8579", "name": "network-vif-plugged", "status": "completed", "tag": "f755fe0e-1a8d-487d-83d5-4a229002245d"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:42.419323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.420041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.420457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.423982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 while it is in vm_state rescued Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Request method failure captured: Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments/461d4e4f-b10d-4e0c-b8ae-11a6963a7083 HTTP/1.1 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc0ZcWOfD09VgBkNMQks-2q_GIo4BRXRof3RM6BbKzpwtDWywIRWIJeE1W8jipzNLnd-sKa4mPw54-poBJBHjDQ7HVOFy4SCgMCcm7yEYbJrtLqcQDBNnEe63Q4Ud7yu-miwuUchxy8MEN4VlfA0XCl8GQj4QsmrL02FxGDFljMWLg Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:31:42.425870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c113bdd75f254073abcfbd109dc7d187", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 820b9a99be574eb8b09629988c4c59c0 Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:31:42.427401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Cannot 'detach_volume' instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 while it is in vm_state rescued Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'server_id': '1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3', 'id': '461d4e4f-b10d-4e0c-b8ae-11a6963a7083'} Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:42.428492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 while it is in vm_state rescued Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 while it is in vm_state rescued Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:31:42.429681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Returning 409 to user: Cannot 'detach_volume' instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 while it is in vm_state rescued {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:42.430597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b2a76263-1fa6-424d-beaf-cbc520e3bfe1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments/461d4e4f-b10d-4e0c-b8ae-11a6963a7083" status: 409 len: 152 microversion: 2.1 time: 0.107027 Aug 23 04:31:42.430597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 329/625] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:31:42 2022] DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments/461d4e4f-b10d-4e0c-b8ae-11a6963a7083 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 04:31:42.433742 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] Creating event network-vif-plugged:f755fe0e-1a8d-487d-83d5-4a229002245d for instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 on hv-cinder-85407 Aug 23 04:31:42.436425 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:42.436981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.438532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-89eee0ad-087d-466b-918c-cb53f1f0335f req-9befa472-86c2-434d-8490-bc4d29b95af1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Aug 23 04:31:42.439305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 297/626] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:42.443195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.443790 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.444252 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.444941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.445387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.445807 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.454913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:42.455608 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.471741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.472264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.472698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.473398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.474150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.474699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.504192 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:42.517080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bf8c10f4-7452-4ded-b08a-1b35307c1da9 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/action" status: 202 len: 0 microversion: 2.1 time: 0.084220 Aug 23 04:31:42.518012 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 330/627] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:31:42 2022] POST /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 04:31:42.526475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:42.527297 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.534565 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.535233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.535968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.537074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.537849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.538515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.556525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:42.665504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.674318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b813bd9d-e30f-4bca-8874-f77e7c4329c9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.223446 Aug 23 04:31:42.674954 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 298/628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:42 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:31:42.711838 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.720646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-47843c6d-f81e-40e6-bf2b-6e5da69379ec tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1723 microversion: 2.1 time: 0.198232 Aug 23 04:31:42.721200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 331/629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:42 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:42.770941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:42.771576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:42.778491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.778985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.779415 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.780133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:42.780576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:42.780991 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:42.912831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.921545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.923024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:42.924159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c1a393cd-0e0a-4415-92e6-0adef7bdae26 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1406 microversion: 2.20 time: 0.157142 Aug 23 04:31:42.924833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 299/630] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:42 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:43.696310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:43.696941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:43.704285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.705072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.705504 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.706186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.706723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.707143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.744751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:43.745412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:43.752233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.752711 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.753143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.753828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.754269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.754704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.888015 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:43.897007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c8765d0a-7260-4a2a-b8dc-2dbccffe2fc6 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.204337 Aug 23 04:31:43.897662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 332/631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:43 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:43.913917 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:43.922453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ee5fd8d8-e22c-4345-8f2d-8802372525de tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1723 microversion: 2.1 time: 0.181962 Aug 23 04:31:43.923015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 300/632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:43 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:43.947202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:43.947834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:43.949749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:43.955294 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.955770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.956220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.956895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:43.957318 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:43.957727 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:43.974308 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=16 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:44.093948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:44.102815 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:44.104347 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:44.105466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0aa8d2bf-476d-4df7-8679-749461b0da49 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1598 microversion: 2.20 time: 0.162270 Aug 23 04:31:44.106217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 333/633] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:31:43 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:31:44.128306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:44.128798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:44.135879 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.136390 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.136897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:44.137766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.138193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.138599 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:44.152794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=8 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:44.220991 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ecfdef3e-ca1b-4d96-a4a2-f20a4816ba48 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096397 Aug 23 04:31:44.221811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 301/634] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Aug 23 04:31:44 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:31:44.918540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:44.919104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:44.925819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.926288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.926712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:44.927387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.927827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.928581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:44.944901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:44.947590 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:44.953942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.954658 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.955145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:44.955889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:44.956424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:44.956903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:45.135345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:45.142205 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:45.144162 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1b112073-1786-42db-b3f2-75ea4fcab7da tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1366 microversion: 2.1 time: 0.229401 Aug 23 04:31:45.145069 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 334/635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:44 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:45.150903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-84e74486-b4fc-4a0c-8ff2-abcaaef9049b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1723 microversion: 2.1 time: 0.210652 Aug 23 04:31:45.151472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 302/636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:44 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:45.187392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:45.196687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:45.197154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:45.197586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:45.208172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] Creating event network-changed:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:31:45.213021 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-21afa528-c25c-48a7-86d6-30540d6940f9 req-c690bd50-8598-4a53-9100-0f14d4cb1ff4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029310 Aug 23 04:31:45.213596 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 335/637] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:46.166268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:46.167413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:46.173663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:46.174756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.174935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:46.175557 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.176191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.176896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.177372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.177789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.183410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.184025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.184847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.185653 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.186198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.187109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.396288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:46.403017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:46.404404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e47af4cd-177b-4598-b7ef-da53f1646786 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1556 microversion: 2.1 time: 0.242013 Aug 23 04:31:46.404950 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 303/638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:46 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:46.411227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-46f6573f-81c1-4fa1-a7d9-58a408e801b7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1723 microversion: 2.1 time: 0.242061 Aug 23 04:31:46.411774 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 336/639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:46 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:46.424419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:46.425172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:46.431379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.431854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.432320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.432996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.433438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.433848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.517230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8c8dd2e0-21ac-4108-80b4-a7fef16f3136 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096144 Aug 23 04:31:46.518015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 304/640] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:31:46 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:46.793142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:46.795405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:46.801753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.802231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.802657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.803725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.804228 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.804641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.833656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c69b4b5e-8a0e-490d-8bd4-e976e9c12c62 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044345 Aug 23 04:31:46.834188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 337/641] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:31:46 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:31:46.901827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:46.902368 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:46.908611 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.909233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.909670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.910374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:46.910826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:46.911243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:46.937734 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:31:47.000565 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:47.019978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-89c9ae8e-3259-4dae-8fc6-7a056102910b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 204 len: 0 microversion: 2.1 time: 0.122713 Aug 23 04:31:47.020577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 305/642] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:31:46 2022] DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:31:47.028926 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:47.029528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:47.035399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.035882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.036361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.037046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.037541 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.037965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.175163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:47.183330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-47334727-1025-4788-b178-efae8dce701b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1674 microversion: 2.1 time: 0.158213 Aug 23 04:31:47.183897 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 338/643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:47 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:47.433248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:47.433945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:47.440569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.441051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.441469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.442150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.442769 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.443188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.588313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:47.597257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-27893b87-7ff3-49e8-b7cc-f7e88e9bf405 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1729 microversion: 2.1 time: 0.168531 Aug 23 04:31:47.597840 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 306/644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:47 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:47.619735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:47.620325 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:47.626888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.627382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.627812 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.628550 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.628998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.629416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.715602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bacb8545-1c00-47c6-b3eb-375286b999d4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100311 Aug 23 04:31:47.716267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 339/645] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:31:47 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:47.833816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c52f9ce-e7c8-4f79-a87f-ce45dadb8579", "tag": "f755fe0e-1a8d-487d-83d5-4a229002245d"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:47.846219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:47.846829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:47.847341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:47.859395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] Creating event network-changed:f755fe0e-1a8d-487d-83d5-4a229002245d for instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 on hv-cinder-85407 Aug 23 04:31:47.864507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-60aabf26-a4ff-4eb9-bac9-e20d280de844 req-ef1bd6a8-6cf6-4f54-bbfe-f7478de8a12e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036640 Aug 23 04:31:47.865201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 307/646] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:48.205310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:48.206094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:48.212414 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:48.212892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:48.213324 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:48.214007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:48.214451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:48.214863 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:48.480069 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:48.488010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-46d9b4b0-34e1-44ea-abae-145d01323f7c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1674 microversion: 2.1 time: 0.287050 Aug 23 04:31:48.488857 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 340/647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:48 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1674 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:48.683898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:48.694839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:48.695361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:48.696003 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:48.707442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] Creating event network-changed:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:31:48.715283 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-c2e4f834-5655-42ce-986c-c66b11e09e17 req-c4e0a27e-a380-491e-bbba-27529fb20a6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035952 Aug 23 04:31:48.716409 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 308/648] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:49.514492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:49.518707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:49.527146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:49.534422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:49.535297 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:49.536288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:49.536940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:49.537956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:49.617996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:49.626882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b0632524-6f8a-4d88-986f-80ae639d8a19 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1606 microversion: 2.1 time: 0.120421 Aug 23 04:31:49.628270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 341/649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:49 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:50.652314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:50.653848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:50.661146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:50.661997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:50.662448 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:50.663399 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:50.663887 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:50.664547 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:50.701148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:50.701729 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:50.702161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:50.702598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:31:50.741362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}, {"server_uuid": "d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b", "name": "network-vif-deleted", "tag": "7ff1585b-e97f-4f6d-a093-a43bf254afd2"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:50.753621 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:50.754067 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:50.754486 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:50.760784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:50.767899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Creating event network-changed:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:31:50.768426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] Creating event network-vif-deleted:7ff1585b-e97f-4f6d-a093-a43bf254afd2 for instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b on hv-cinder-85407 Aug 23 04:31:50.769142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d28e275d-507e-49f6-8b6f-c1c866ef08f4 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 200 len: 1326 microversion: 2.1 time: 0.121836 Aug 23 04:31:50.769844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 309/650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:50 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:50.775085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-62f09561-8337-45a7-8fdb-edb53decacd7 req-6d9f10c8-50c6-48df-b48c-9f7d8a44a31f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038127 Aug 23 04:31:50.775993 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 342/651] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:51.793731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:51.794538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:51.803796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:51.804470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:51.805022 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:51.805931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:51.806514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:51.807064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:51.823952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b HTTP/1.1 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:31:51.825668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:31:51.827130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'd37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b'} Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:31:51.828001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:31:51.829335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:31:51.830660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:31:51.830660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8ef924c7-a302-4104-a29e-8a5c174a9214 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 404 len: 111 microversion: 2.1 time: 0.039370 Aug 23 04:31:51.830864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 310/652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:51 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:31:51.837234 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c63696fd-674d-49bd-b9f8-901804d62171 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '.version_select at 0x7f9c16e38670>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:51.859281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c63696fd-674d-49bd-b9f8-901804d62171 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830904293" status: 202 len: 0 microversion: 2.1 time: 0.026944 Aug 23 04:31:51.859831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 343/653] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Aug 23 04:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830904293 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:31:52.522725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5ab19175-dbe9-4935-b997-732c9cf9d896 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: .version_select at 0x7f9c16f361f0>, body: {"keypair": {"name": "tempest-keypair-312777414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD60m7ZnXI7gKKdqrCqA9Q/w3q2n9hSgg+w6q/moRcEeNoPAs2tEwicZafRy3mDnGJswr3M4Jko7FN1vsjP5FUqu3QtkxbQCFJdvyqMwtpNxk/3jmTyXAitkjFaFIBXxw=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:52.538939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-5ab19175-dbe9-4935-b997-732c9cf9d896 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for project 620abd3a734b4502afa795d2cc58dadf. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:52.543096 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-5ab19175-dbe9-4935-b997-732c9cf9d896 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for user 658ce95360454ea1a96a22af310e5a4f and project 620abd3a734b4502afa795d2cc58dadf. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:52.569347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5ab19175-dbe9-4935-b997-732c9cf9d896 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050538 Aug 23 04:31:52.569879 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 311/654] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:31:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:53.912221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1580001106", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a554d691-3edb-400b-bdf3-7ffd755600af"}], "security_groups": [{"name": "tempest-securitygroup--565632619"}], "key_name": "tempest-keypair-312777414", "user_data": "}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:54.030498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] validate_networks() for [('a554d691-3edb-400b-bdf3-7ffd755600af', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:31:54.437291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:31:54.437818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:31:54.438622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:31:54.438996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:31:54.439473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:31:54.450777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:54.451230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:54.451654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:54.452400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:54.452846 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:54.453259 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:54.470637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for project 620abd3a734b4502afa795d2cc58dadf. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:31:54.475063 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Getting quotas for user 658ce95360454ea1a96a22af310e5a4f and project 620abd3a734b4502afa795d2cc58dadf. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:31:54.485914 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:31:54.488244 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:31:54.541763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9d9d252c-9bb2-44c9-872a-9cfe2bd0e134 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634460 Aug 23 04:31:54.542437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 344/655] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:31:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:31:54.555139 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b3223f44-a314-4f8e-85f5-8d1d313d6cd1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:54.555889 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b3223f44-a314-4f8e-85f5-8d1d313d6cd1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:54.612533 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3223f44-a314-4f8e-85f5-8d1d313d6cd1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:54.620586 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b3223f44-a314-4f8e-85f5-8d1d313d6cd1 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1237 microversion: 2.1 time: 0.070596 Aug 23 04:31:54.621164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 312/656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:54 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:55.642417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:55.643101 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:55.654844 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:55.655320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:55.655745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:55.656472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:55.656944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:55.657351 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:55.741391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:55.750777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-143b1719-7abd-43a4-95b0-71fcfbb19d06 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1307 microversion: 2.1 time: 0.113574 Aug 23 04:31:55.752439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 345/657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:55 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:56.773635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:56.774243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:56.780234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:56.780714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:56.781139 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:56.781829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:56.782274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:56.782690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:56.997133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:57.005498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6c83221d-dbc4-46fb-a8a7-8e485cccd1e9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.236265 Aug 23 04:31:57.006234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 313/658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:56 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:57.102540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6510fe12-9cc4-4920-af3c-738d3861a06b", "tag": "cbb16d9f-5de1-4a2e-be50-a2f360416458"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:31:57.115706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:57.117418 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:57.117854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:57.130190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] Creating event network-changed:cbb16d9f-5de1-4a2e-be50-a2f360416458 for instance 6510fe12-9cc4-4920-af3c-738d3861a06b on hv-cinder-85407 Aug 23 04:31:57.136575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-12a52435-b3d6-47ad-b9bc-d87b89cb92d2 req-5bd4e428-90db-4ceb-b315-f2d20f249ad8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038876 Aug 23 04:31:57.137186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 346/659] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:31:58.029688 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:58.030649 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:58.041689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:58.042381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:58.043009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:58.044029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:58.044697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:58.045197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:58.179210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:58.187189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cd0c26b8-fbed-4615-ad60-35e91525970f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.163284 Aug 23 04:31:58.187748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 314/660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:58 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:31:59.213539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:31:59.214728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:31:59.226488 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:59.227524 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:59.227790 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:59.228504 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:31:59.228951 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:31:59.229362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:31:59.372656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:31:59.384255 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-eaace077-ae52-4c8a-a6c8-6610bf7ead27 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.178290 Aug 23 04:31:59.384987 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 347/661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:31:59 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:00.416352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:00.417120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:00.424493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:00.424971 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:00.425404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:00.426100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:00.426553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:00.426966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:00.563457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:00.574988 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0cbed311-cf4c-4588-a61a-404f8e784142 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.167389 Aug 23 04:32:00.575564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 315/662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:00 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:01.600598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:01.601582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:01.612573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:01.613354 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:01.614059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:01.615170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:01.615989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:01.616675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:01.763002 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:01.772723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-be734513-fffd-4f87-ae27-f7817e22007b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.179055 Aug 23 04:32:01.773290 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 348/663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:01 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:02.273883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6510fe12-9cc4-4920-af3c-738d3861a06b", "name": "network-vif-plugged", "status": "completed", "tag": "cbb16d9f-5de1-4a2e-be50-a2f360416458"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:02.283888 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:02.284894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:02.284894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:02.296524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] Creating event network-vif-plugged:cbb16d9f-5de1-4a2e-be50-a2f360416458 for instance 6510fe12-9cc4-4920-af3c-738d3861a06b on hv-cinder-85407 Aug 23 04:32:02.301875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-57f60e6b-389a-43fd-8811-a23f33f99bf5 req-54b104ac-27c6-4587-bdd6-5b783030c3de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Aug 23 04:32:02.302490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 316/664] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:02.801184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:02.802292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:02.813147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:02.813930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:02.814624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:02.815741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:02.816517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:02.817204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:02.954508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:02.967242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-159c5295-fc4d-47f7-8ff4-97eda1068dcb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.172315 Aug 23 04:32:02.967987 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 349/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:02 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:03.997425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:03.998115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:04.004778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:04.005253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:04.005683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:04.006366 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:04.006814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:04.007227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:04.395739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:04.404211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f9b62b4b-0eaa-4a06-8dc7-b1113fe3256a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1362 microversion: 2.1 time: 0.413575 Aug 23 04:32:04.404739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 317/666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:03 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:05.429356 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:05.430369 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:05.433462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:05.434113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=6 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:05.440440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:05.440952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:05.441409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:05.442151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:05.442610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:05.443044 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:05.583810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:05.593459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5417fdda-e5cf-42c2-bcc5-a43dbba4aa5e tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1549 microversion: 2.1 time: 0.170588 Aug 23 04:32:05.594018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 350/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:05 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:05.614574 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:05.615131 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:05.617029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:05.623433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:05.623898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:05.624360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:05.625039 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:05.625464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:05.625876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:05.642692 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:05.714587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-13057911-4276-47c1-9dda-f0df8989eabd tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103485 Aug 23 04:32:05.715564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 318/668] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:32:05 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:06.722013 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6510fe12-9cc4-4920-af3c-738d3861a06b", "tag": "cbb16d9f-5de1-4a2e-be50-a2f360416458"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:06.733266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:06.733731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:06.734147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:06.747402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] Creating event network-changed:cbb16d9f-5de1-4a2e-be50-a2f360416458 for instance 6510fe12-9cc4-4920-af3c-738d3861a06b on hv-cinder-85407 Aug 23 04:32:06.752268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-f0a2bbfc-6108-49cc-85fe-0712401f13e3 req-8fed6335-87eb-4e95-821a-733f632998d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Aug 23 04:32:06.753024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 351/669] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:24.171095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:24.178259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:24.179107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:24.187180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:24.187647 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:24.188143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:24.188835 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:24.189269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:24.189675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:24.214938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6f61d057-095a-486d-8d65-1ed9ea04014e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/ips" status: 200 len: 149 microversion: 2.1 time: 0.046906 Aug 23 04:32:24.215545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 319/670] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:32:24 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:25.584327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab6eaa6-5f3a-4649-9974-e82a8e03a675"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:25.587618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:25.590282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:25.590905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=95 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:25.597155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:25.597627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:25.598032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:25.598710 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:25.599149 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:25.599866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:26.045413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7fe345f6-ae78-4fc5-bc84-7cd1b3aa457d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467916 Aug 23 04:32:26.045992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 352/671] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:32:25 2022] POST /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:26.920354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:26.920886 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:26.927333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:26.927818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:26.928316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:26.928997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:26.929456 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:26.929872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:27.069989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'services' on Instance uuid 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:32:27.147823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-89e5bf76-404c-449a-b85a-d12c08b07e3f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments/461d4e4f-b10d-4e0c-b8ae-11a6963a7083" status: 202 len: 0 microversion: 2.1 time: 0.231383 Aug 23 04:32:27.148612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 320/672] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:32:26 2022] DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments/461d4e4f-b10d-4e0c-b8ae-11a6963a7083 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:32:27.158100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:27.161025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:27.167583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:27.168305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:27.168909 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:27.169771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:27.170374 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:27.171093 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:27.202092 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5de6ab3d-c57a-46b6-bc01-0da88e4cee1d tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048864 Aug 23 04:32:27.202757 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 353/673] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:27 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:28.215389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:28.217794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:28.224883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:28.225361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:28.225792 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:28.226477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:28.226921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:28.227336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:28.259214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5a135afa-e47f-4818-bcdb-733ec6bf87b0 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Aug 23 04:32:28.259749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 321/674] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:28 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:29.102519 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:29.103025 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:29.109893 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:29.110371 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:29.110800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:29.111484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:29.111944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:29.112384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:29.136535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7f990312-a63e-40c4-8ac7-291dddcdc804 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/ips" status: 200 len: 151 microversion: 2.20 time: 0.102846 Aug 23 04:32:29.137103 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 354/675] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Aug 23 04:32:29 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:32:29.275210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:29.278541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:29.285074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:29.285584 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:29.285992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:29.286664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:29.287127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:29.287541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:29.325140 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d07192fe-69b3-4116-a387-1cb5664a2ff2 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057225 Aug 23 04:32:29.325818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 322/676] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:29 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:30.337816 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:30.340282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:30.346964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:30.347453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:30.348155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:30.348827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:30.349578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:30.349985 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:30.382009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-711d91a8-2ec7-40f1-a3a2-65f19867d009 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048184 Aug 23 04:32:30.382569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 355/677] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:30 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:31.002220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:31.002799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:31.009514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.009992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.010416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.011092 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.011563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.011969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.035020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lazy-loading 'flavor' on Instance uuid 23fa23cb-802d-4f77-a8e8-1186afbb359d {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:32:31.264310 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9e2b474a-fd15-4b41-9c53-c9c7c92f6222 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/action" status: 202 len: 0 microversion: 2.20 time: 0.265817 Aug 23 04:32:31.265082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 323/678] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Aug 23 04:32:30 2022] POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:32:31.273476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:31.274073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:31.281272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.281781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.282208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.282949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.283388 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.283800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.394985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:31.397272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:31.404431 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.404894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.405337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.406075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:31.406509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:31.406925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:31.424406 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:31.433179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:31.434672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:31.435817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-21af2b9a-b254-434f-8b06-da49c8bea109 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.166222 Aug 23 04:32:31.436390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 356/679] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:31 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:31.441573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bd685869-c929-4139-8940-78d187e8b53f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050877 Aug 23 04:32:31.442200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 324/680] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:31 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:32.458842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:32.463291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:32.471423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:32.472041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:32.472827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:32.474196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:32.474196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:32.474693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:32.475075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:32.475396 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:32.484860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:32.485540 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:32.485978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:32.486747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:32.487238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:32.487872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:32.515856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0201073b-5c58-4227-8d43-5f64e03e7a7b tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064714 Aug 23 04:32:32.516653 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 357/681] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:32 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:32.627760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:32.636088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:32.637570 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:32.638722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-903f3a9d-41f0-4cb0-ba19-a7bf905928fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.173835 Aug 23 04:32:32.639275 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 325/682] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:32 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:33.532507 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:33.536036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.544739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.545211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.545631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.546537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.546984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.547395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.576695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-432b81ac-ebac-4a92-8641-3eb53ea3f2f3 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050754 Aug 23 04:32:33.582484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 358/683] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:33 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:32:33.649226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab6eaa6-5f3a-4649-9974-e82a8e03a675"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:33.651813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.658685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.659162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.659589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.660314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.660435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:33.660758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.660870 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.661175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.666717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.667528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.668010 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.668707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.669183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.669592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.695228 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:32:33.750499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: POST /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments HTTP/1.1 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 74 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:32:33.752464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {"volumeAttachment": {"volumeId": "4ab6eaa6-5f3a-4649-9974-e82a8e03a675"}} Aug 23 04:32:33.754008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'server_id': '9c52f9ce-e7c8-4f79-a87f-ce45dadb8579', 'body': {'volumeAttachment': {'volumeId': '4ab6eaa6-5f3a-4649-9974-e82a8e03a675'}}} Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:33.754882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:33.756336 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 400 to user: Invalid volume: volume 4ab6eaa6-5f3a-4649-9974-e82a8e03a675 is already attached to instances: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d5836beb-abbd-4737-ae0a-cbea0324d107 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109088 Aug 23 04:32:33.757818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 326/684] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:32:33 2022] POST /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:32:33.762653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:33.763271 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.770521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.771246 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.771705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.772500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.773110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.773690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.796769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7c0a9864-071a-4603-954b-b400227a9090 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 204 len: 0 microversion: 2.1 time: 0.140333 Aug 23 04:32:33.797904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 359/685] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:32:33 2022] DELETE /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:32:33.808476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:33.809331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.824405 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.825088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.825526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.826707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.827154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.827600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.962420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:33.971386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:33.973127 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:33.974276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-61ee35d4-3f5c-49fd-98c6-908004ed6b76 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.219011 Aug 23 04:32:33.975283 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 327/686] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:33 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:33.980513 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:33.980995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:33.987231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.987700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.988164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.988860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:33.989329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:33.989719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:33.993142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:34.001519 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-02c37a26-81f6-4c55-a7e5-92015a97c1d7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1689 microversion: 2.1 time: 0.198186 Aug 23 04:32:34.002077 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 360/687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:33 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:34.069156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lazy-loading 'services' on Instance uuid 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:32:34.150070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-38d0e1a9-a239-48db-ad80-a920a777f464 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments/4ab6eaa6-5f3a-4649-9974-e82a8e03a675" status: 202 len: 0 microversion: 2.1 time: 0.173309 Aug 23 04:32:34.150648 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 328/688] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:32:33 2022] DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments/4ab6eaa6-5f3a-4649-9974-e82a8e03a675 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:32:34.162554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:34.166046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:34.172807 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:34.173281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:34.173708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:34.174729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:34.174850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:34.175203 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:34.205337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b4453baa-e606-48c1-813f-09813b8e9267 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049639 Aug 23 04:32:34.205877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 361/689] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:34 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:35.000809 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:35.001561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:35.008892 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.009415 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.009884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.010635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.011120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.011577 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.022537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:35.023143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:35.029965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.030762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.031196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.031886 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.032363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.032782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.206989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:35.216029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:35.217606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:35.218794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-418caed8-8635-46c0-80a5-56499fae61a6 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.223493 Aug 23 04:32:35.219333 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 329/690] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:34 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:35.220254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:35.228755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f6c5a69b-7b89-4034-aee7-f2949bf9f106 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1689 microversion: 2.1 time: 0.209975 Aug 23 04:32:35.229627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 362/691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:35 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:35.230037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:35.232380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:35.238552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.239032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.239485 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.240201 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:35.240650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:35.241067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:35.270609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9bc525f8-8aa0-4b10-98d5-65d3ba684cfe tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049418 Aug 23 04:32:35.271074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 330/692] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:35 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:36.245955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:36.246956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:36.254308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:36.255329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:36.258064 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.258826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.259536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.260711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.261451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.262143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.265952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.266724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.267434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.268980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.269436 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.269857 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.462396 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:36.466107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:36.471303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:36.473249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:36.474155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c62a13d0-3764-49c6-9f3c-5e3fdcc11e27 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1689 microversion: 2.1 time: 0.227215 Aug 23 04:32:36.474705 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2dcf62d5-474f-4401-96f5-9a9fe57e67eb tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.235164 Aug 23 04:32:36.475015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 331/693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:36 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:36.479201 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 363/694] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:36 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:36.479847 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:36.482315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:36.488616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.489101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.489528 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.490208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:36.490653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:36.491067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:36.507729 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:36.522059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8618035a-4944-4067-b350-50e20f9962af tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Aug 23 04:32:36.522618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 332/695] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:36 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:37.496634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:37.497233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:37.498176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:37.498782 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:37.504621 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.505086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.505495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.505662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.505970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.506181 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.506382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.506623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.507029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.507164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.507497 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.508007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.806214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:37.815582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:37.815807 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:37.818071 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:37.819098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b3a0f45e-1608-4789-84dd-1bedab70a4bd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.325401 Aug 23 04:32:37.820164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 333/696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:37 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:37.824812 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d890786d-46c0-4184-8bca-16ee3fae5cd7 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1689 microversion: 2.1 time: 0.332112 Aug 23 04:32:37.825421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 364/697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:37 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1689 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:37.831532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:37.833910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:37.841556 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.842257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.842799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.843575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.844148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.844651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.880674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1ae31189-dfb9-4d56-bcbd-21cc9238e01d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059619 Aug 23 04:32:37.881479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 334/698] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:37 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:32:37.946217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:37.946696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:37.952535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.953005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.953422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.954091 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:37.954528 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:37.954910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:37.980998 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:32:37.984063 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:38.067232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2f055646-4ca3-407c-b667-b0d9ce00c112 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 204 len: 0 microversion: 2.1 time: 0.124453 Aug 23 04:32:38.067709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 365/699] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:32:37 2022] DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:32:38.076486 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:38.077088 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:38.083542 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.084079 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.084490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.085161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.085597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.086006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.289609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:38.298038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bd66fceb-4059-424b-9be1-ff8a4923eb37 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1680 microversion: 2.1 time: 0.225558 Aug 23 04:32:38.298694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 335/700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:38 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:38.632451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3", "name": "network-vif-deleted", "tag": "4c9d7f64-2968-4d76-afad-0620fa10df9e"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:38.642793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.643332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.643782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.655827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] Creating event network-vif-deleted:4c9d7f64-2968-4d76-afad-0620fa10df9e for instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 on hv-cinder-85407 Aug 23 04:32:38.663498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-d512d519-c301-42da-a01c-4f867ad09c16 req-2108ce78-6d2b-47c5-b9d8-073e245908f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Aug 23 04:32:38.664976 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 366/701] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:38.843469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:38.844035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:38.847291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:38.847961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:38.851808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.852413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.852920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.853685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.854249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.854747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.854864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.855446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.855939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.856785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:38.857370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:38.857969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:38.948611 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:38.957939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-88bbd312-185e-42ca-94f5-2673d8f9fd7c tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 200 len: 1621 microversion: 2.1 time: 0.115722 Aug 23 04:32:38.958723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 367/702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:38 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 1621 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:39.019629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:39.028470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:39.029965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:39.031719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fd04dc44-6cbe-4552-b3a4-6a917d059cce tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.192216 Aug 23 04:32:39.032285 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 336/703] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:38 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:39.323718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:39.324513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:39.331862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:39.332436 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:39.332865 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:39.333586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:39.334063 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:39.334508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:39.477588 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:39.485965 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4365b44d-167a-4536-b026-8da25ec84901 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1680 microversion: 2.1 time: 0.167289 Aug 23 04:32:39.486604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 368/704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:39 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:39.980762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:39.981402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:39.988197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:39.988675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:39.989098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:39.989780 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:39.990221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:39.990635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.004474 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] HTTP exception thrown: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Request method failure captured: Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 HTTP/1.1 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc0ZcWOfD09VgBkNMQks-2q_GIo4BRXRof3RM6BbKzpwtDWywIRWIJeE1W8jipzNLnd-sKa4mPw54-poBJBHjDQ7HVOFy4SCgMCcm7yEYbJrtLqcQDBNnEe63Q4Ud7yu-miwuUchxy8MEN4VlfA0XCl8GQj4QsmrL02FxGDFljMWLg Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:32:40.006129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c113bdd75f254073abcfbd109dc7d187", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 820b9a99be574eb8b09629988c4c59c0 Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. Aug 23 04:32:40.007726 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3'} Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:32:40.008846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. Aug 23 04:32:40.010249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:40.011702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Returning 404 to user: Instance 1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:32:40.011702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4da6dbd5-a39d-4519-98ac-6741c5d2c17e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3" status: 404 len: 111 microversion: 2.1 time: 0.031191 Aug 23 04:32:40.011702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 337/705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:39 2022] GET /compute/v2.1/servers/1b7d4d4d-5c8f-4e34-8d8c-8aeda18a8aa3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:32:40.017230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-28f1728e-e50a-4773-bf75-ef71d3f86bf4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '.version_select at 0x7f9c16e0c430>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:40.037635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-28f1728e-e50a-4773-bf75-ef71d3f86bf4 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685386298" status: 202 len: 0 microversion: 2.1 time: 0.024292 Aug 23 04:32:40.038125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 369/706] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Aug 23 04:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685386298 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:32:40.058672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:40.059589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:40.065694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:40.066177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:40.066783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.067482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:40.067950 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:40.068378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.321462 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:40.331011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:40.332829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:40.334273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-aefdc6a2-7cac-4e89-a249-b0866f52da1f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.279546 Aug 23 04:32:40.334817 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 338/707] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:40 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:40.509154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:40.509760 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:40.521278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:40.521996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:40.522646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.523546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:40.524334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:40.525022 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.600446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:40.612863 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d276ef9b-4042-4f4e-a386-851955a33595 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 200 len: 1613 microversion: 2.1 time: 0.107963 Aug 23 04:32:40.613416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 370/708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:40 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 1613 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:40.802478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c52f9ce-e7c8-4f79-a87f-ce45dadb8579", "name": "network-vif-deleted", "tag": "f755fe0e-1a8d-487d-83d5-4a229002245d"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:40.814526 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:40.816247 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:40.816896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:40.833986 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] Creating event network-vif-deleted:f755fe0e-1a8d-487d-83d5-4a229002245d for instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 on hv-cinder-85407 Aug 23 04:32:40.840320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-715265a6-73a7-4040-bbeb-26e813592370 req-6b40a3eb-b6e5-47f4-b256-9188ed6f2944 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043526 Aug 23 04:32:40.841655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 339/709] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:41.358779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:41.359398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:41.366107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:41.366581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:41.366991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:41.367676 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:41.368140 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:41.368792 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:41.507542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:41.515758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:41.517305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:41.518675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b6333e9b-d484-48fd-a421-dc5b10819c40 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.164023 Aug 23 04:32:41.519306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 371/710] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:41 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:41.638145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:41.638890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:41.647395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:41.647872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:41.648344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:41.649026 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:41.649478 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:41.649902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:41.664216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 HTTP/1.1 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:32:41.666081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:32:41.667403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '9c52f9ce-e7c8-4f79-a87f-ce45dadb8579'} Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:32:41.668315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:32:41.669403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:32:41.671045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:32:41.671045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1edce837-f967-4014-b85a-dff8e2dd0d3a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 404 len: 111 microversion: 2.1 time: 0.036091 Aug 23 04:32:41.671045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 340/711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:41 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:32:41.676936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-31de30f3-f590-4e4c-a033-b338891b36ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '.version_select at 0x7f9c16e2b700>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:41.699257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-31de30f3-f590-4e4c-a033-b338891b36ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309381846" status: 202 len: 0 microversion: 2.1 time: 0.026382 Aug 23 04:32:41.700023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 372/712] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Aug 23 04:32:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309381846 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:32:42.541637 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:42.542240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:42.548624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:42.551186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:42.551186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:42.551186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:42.551186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:42.553598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:42.616940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-17401e7e-bd3c-4b8e-8d9c-12aa8932a268 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: .version_select at 0x7f9c16ddeaf0>, body: {"keypair": {"name": "tempest-keypair-1325908092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx9B+70vDGcf5SA8P9B5+r6EsfKJyvuGP86d+PEaroM22tnZrb+3PLnb32Q+OFA0b7t96Ido/hWN96YAjvO7yLs4zhzjZ0pYC66dBQg0j8qiUT4jYZX7mdKGyx3u4/+aA=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:42.633666 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-17401e7e-bd3c-4b8e-8d9c-12aa8932a268 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:32:42.637760 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-17401e7e-bd3c-4b8e-8d9c-12aa8932a268 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:32:42.661335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-17401e7e-bd3c-4b8e-8d9c-12aa8932a268 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048777 Aug 23 04:32:42.662157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 373/713] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:32:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:42.687036 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:42.696358 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:42.697843 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:42.698989 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-addc3a23-34c7-4628-8433-cb619779d81d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.161361 Aug 23 04:32:42.699860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 341/714] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:42 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:43.289020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:43.289642 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:43.296309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.296797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.297220 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.298057 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.298822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.299261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.325645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:32:43.404864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6c08a092-e8b4-4e1b-9c83-c4499a8369c8 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 204 len: 0 microversion: 2.1 time: 0.119551 Aug 23 04:32:43.405477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 374/715] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:32:43 2022] DELETE /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:32:43.414377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:43.415240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:43.421880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.422373 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.422804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.423496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.423991 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.424420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.655386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:43.666778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9d583c2a-e401-4558-9593-45775b367080 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1507 microversion: 2.1 time: 0.255921 Aug 23 04:32:43.667695 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 342/716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:43 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:43.722882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:43.723575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:43.730606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.731105 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.732192 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.732876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:43.733315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:43.733723 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:43.967892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:43.976896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:43.978440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:43.979747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a499990a-d4c2-490e-87df-490797af1071 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.261622 Aug 23 04:32:43.981046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 375/717] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:43 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:44.086871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191968802", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c6be732-b40b-47aa-8b96-da7512121793"}], "security_groups": [{"name": "tempest-securitygroup--1439485914"}], "key_name": "tempest-keypair-1325908092", "user_data": "}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:44.198727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] validate_networks() for [('8c6be732-b40b-47aa-8b96-da7512121793', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:32:44.683779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:32:44.684233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:32:44.684699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:32:44.685163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:32:44.685482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:32:44.690466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:44.691067 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:44.695834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.696375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.696808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.697178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.697636 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.697788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.697937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.698073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.698355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.698704 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.699148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.699559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.716003 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:32:44.720078 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Getting quotas for user a91872508ecd49d98bd95651412f85a2 and project 52ab946e7d0d4a5397945bfcbf49e723. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:32:44.732342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:32:44.734676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:32:44.786156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2419af54-77d8-49b6-9c16-4f832154f000 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.703566 Aug 23 04:32:44.786804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 343/718] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:32:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:32:44.842122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:44.851338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-14cbe892-8deb-4720-be7b-4ce674b21bbf tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1507 microversion: 2.1 time: 0.164692 Aug 23 04:32:44.861700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 376/719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:44 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:44.862016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:44.862016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:44.867962 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fb53b649-401a-4ac6-bc5b-8ace457e5817 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:44.868583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fb53b649-401a-4ac6-bc5b-8ace457e5817 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:44.869653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.870182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.871591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.872347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:44.872801 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:44.873386 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:44.900736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4fc5eec0-9b27-4884-bf1f-57bb829b712b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/ips" status: 200 len: 147 microversion: 2.1 time: 0.112895 Aug 23 04:32:44.901286 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 344/720] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:32:44 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/ips => generated 147 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:44.928737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fb53b649-401a-4ac6-bc5b-8ace457e5817 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:44.935595 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fb53b649-401a-4ac6-bc5b-8ace457e5817 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1241 microversion: 2.1 time: 0.082388 Aug 23 04:32:44.936195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 377/721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:44 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:45.005294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:45.006120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:45.014039 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.014714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.015128 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:45.016038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.016470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.017060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:45.174223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:45.183775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:45.185300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:45.187107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-34aeec74-11de-4854-b7e9-d3c198d1d001 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.187089 Aug 23 04:32:45.187667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 345/722] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:44 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:45.873024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:45.873643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:45.882073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.882565 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.882977 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:45.883657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.884144 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.884557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:45.957416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:45.958017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:45.964927 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.965403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.965860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:45.966554 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:45.967113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:45.967560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.069188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:46.077949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ae9cc26c-5f76-40f6-b516-d2b7387f4600 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1293 microversion: 2.1 time: 0.124750 Aug 23 04:32:46.079436 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 346/723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:45 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:46.116543 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:46.126338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-35180b43-94bd-4cce-9f28-9a3b81373e7f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1507 microversion: 2.1 time: 0.257209 Aug 23 04:32:46.126911 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 378/724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:45 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:46.216644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:46.217433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:46.229861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:46.232277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:46.232787 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.235521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:46.236113 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:46.237322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.277331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "417edd00-a109-468e-bca8-2d5be9aba9db"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:46.279854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:46.286041 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:46.286742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:46.287322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.288206 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:46.288793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:46.289382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.449677 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:46.469106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:46.470605 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:46.471939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-de6321d9-ab86-4dba-844e-9ab0fc4d1108 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.262901 Aug 23 04:32:46.472502 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 347/725] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:46 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:46.628674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e942f38b-c544-4991-8221-872266e4e196", "name": "network-vif-deleted", "tag": "ccfb2bb6-9852-46f4-93c8-346e9d6dfb17"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:46.640346 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:46.641296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:46.641967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:46.657049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] Creating event network-vif-deleted:ccfb2bb6-9852-46f4-93c8-346e9d6dfb17 for instance e942f38b-c544-4991-8221-872266e4e196 on hv-cinder-85407 Aug 23 04:32:46.664342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-2ce85ccd-7f90-4caf-8601-576a0993982a req-df89f178-f505-4389-8d5f-3692f06add0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Aug 23 04:32:46.665589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 348/726] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:32:46.730804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9f84bb0d-0ec2-45e6-aad5-2c1357d8562a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457065 Aug 23 04:32:46.731558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 379/727] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:32:46 2022] POST /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:32:47.104072 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:47.106015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:47.118037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.118787 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.119432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.120493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.121135 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.121754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.148246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:47.149157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:47.170619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.171952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.172585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.173468 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.174147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.174941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.223374 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.223848 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.224765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.225359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'fault' on Instance uuid e942f38b-c544-4991-8221-872266e4e196 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:32:47.285575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:47.295695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-12e86ed3-bf9d-4015-918a-782d9b3500ed tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 200 len: 1312 microversion: 2.1 time: 0.152308 Aug 23 04:32:47.296319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 380/728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:47 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:47.310105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:47.318414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5e325114-22ec-44c1-8529-122c89e796bb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.223003 Aug 23 04:32:47.318982 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 349/729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:47 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:47.495765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:47.496394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:47.502800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.503268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.503789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.504497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.504970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.505409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.646805 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:47.655322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:47.656835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:47.657982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b8c41111-7034-4736-9b4c-710d314ab880 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1743 microversion: 2.20 time: 0.166177 Aug 23 04:32:47.658618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 381/730] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:47 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:32:47.721197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1e9d26-fd17-41d4-abec-7355b833a3c0", "tag": "ec052b71-523a-46a8-82ad-e8f3b02837b2"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:47.731482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:47.732167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:47.732606 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:47.744196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] Creating event network-changed:ec052b71-523a-46a8-82ad-e8f3b02837b2 for instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 on hv-cinder-85407 Aug 23 04:32:47.749166 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-3bb1ccb8-974a-4167-bdd6-877b972b365f req-d78892fb-e1eb-4239-824a-02579d8ae090 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031737 Aug 23 04:32:47.750080 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 350/731] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:32:48.317799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:48.318408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: e942f38b-c544-4991-8221-872266e4e196] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:48.325964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.326503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.326984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.327745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.328277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.328742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.337315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:48.340294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:48.340994 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:48.347567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.348081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.348496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.349184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.350020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.350174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] HTTP exception thrown: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. Aug 23 04:32:48.350360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Request method failure captured: Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 HTTP/1.1 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc0ZcWOfD09VgBkNMQks-2q_GIo4BRXRof3RM6BbKzpwtDWywIRWIJeE1W8jipzNLnd-sKa4mPw54-poBJBHjDQ7HVOFy4SCgMCcm7yEYbJrtLqcQDBNnEe63Q4Ud7yu-miwuUchxy8MEN4VlfA0XCl8GQj4QsmrL02FxGDFljMWLg Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:32:48.351602 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c113bdd75f254073abcfbd109dc7d187", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 820b9a99be574eb8b09629988c4c59c0 Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. Aug 23 04:32:48.353099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'e942f38b-c544-4991-8221-872266e4e196'} Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:32:48.353888 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. Aug 23 04:32:48.355126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:48.356311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Returning 404 to user: Instance e942f38b-c544-4991-8221-872266e4e196 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:32:48.356311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bc493b01-a62d-495c-8b6c-81d13c263f13 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196" status: 404 len: 111 microversion: 2.1 time: 0.039884 Aug 23 04:32:48.356311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 382/732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:48 2022] GET /compute/v2.1/servers/e942f38b-c544-4991-8221-872266e4e196 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:32:48.361920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:48.362513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:48.365553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:48.369621 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.370095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.370527 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.371211 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.371654 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.372099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.399792 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:32:48.481597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1f586af6-4675-4549-8068-d7239865f05f tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 204 len: 0 microversion: 2.1 time: 0.123329 Aug 23 04:32:48.482020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 383/733] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:32:48 2022] DELETE /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:32:48.484474 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:48.490852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:48.491529 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:48.492369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-346157a6-5be1-4913-b899-a552de22fdff tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.157371 Aug 23 04:32:48.492930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 351/734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:48 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:48.501663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.502142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.502576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.503267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.503694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.504132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.655173 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:48.663573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4ec64a13-3dd3-4755-a5e6-4771ca142c42 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.177228 Aug 23 04:32:48.664161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 384/735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:48 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:48.681212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:48.681927 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:48.688049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.688519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.688948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.689595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:48.690105 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:48.690513 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:48.834603 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:48.843007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:48.844437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:48.845585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-423e56eb-6988-45a3-9022-becc14c00eb8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1743 microversion: 2.20 time: 0.168299 Aug 23 04:32:48.846271 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 352/736] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:48 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:49.517190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:49.518650 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:49.529215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.529996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.530711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:49.531810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.532607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.533318 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:49.675387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:49.684358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2fd3188c-0165-438d-b572-ba686fe7c66e tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.173534 Aug 23 04:32:49.684697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:49.685267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 385/737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:49 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:49.685390 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:49.692638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.693120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.693552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:49.694203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.694651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.695098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:49.714776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:49.847747 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:49.861131 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-018d6253-020c-484a-8365-00fa01fa6678 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.179727 Aug 23 04:32:49.861340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 353/738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:49 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:49.868819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:49.869412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:49.883866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.884716 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.885463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:49.886712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:49.887484 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:49.888176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:50.031434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:50.040160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:50.041626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:50.042762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d68c474b-5a2f-4446-af68-9082a09e9c52 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1743 microversion: 2.20 time: 0.177903 Aug 23 04:32:50.043281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 386/739] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:49 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:50.705003 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:50.705928 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:50.713078 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:50.713556 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:50.713978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:50.714664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:50.715103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:50.715492 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:50.853009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:50.861082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5e52a5d9-917f-4f90-9c1b-75914495924a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.160006 Aug 23 04:32:50.861724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 354/740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:50 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:50.882673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:50.883421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:50.890322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:50.890804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:50.891238 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:50.891956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:50.892423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:50.892912 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:51.029657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:51.037685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e7e470a3-e3f9-4757-916d-6bf437f258d1 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.159002 Aug 23 04:32:51.038319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 387/741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:50 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:51.065686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:51.066288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:51.072227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:51.072689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:51.073106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:51.073776 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:51.074211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:51.074617 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:51.204011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:51.212491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:51.213967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:51.215114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dc23b864-09e0-4198-a17d-1a3cff71c303 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1743 microversion: 2.20 time: 0.153433 Aug 23 04:32:51.215637 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 355/742] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:51 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:51.881587 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:51.882195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:51.890472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:51.891080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:51.891397 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:51.892125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:51.892573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:51.893791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.061396 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:52.063436 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:52.073496 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.073973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.074392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.075348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.075985 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.076549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.122950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:52.140272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-977dd443-6c30-427d-8459-34f2af0a7a40 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.256583 Aug 23 04:32:52.141920 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 388/743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:51 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:52.239585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:52.240560 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:52.249333 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.250080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.250696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.251597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.252166 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.253197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.381765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:52.392363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e416d505-a1fb-41d0-af7d-3094c84346d6 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1521 microversion: 2.1 time: 0.338269 Aug 23 04:32:52.411246 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 356/744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:52 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:52.506917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:52.517040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:52.520544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:52.522141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f03cffae-d59c-400e-8943-cbca54dcff75 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.287671 Aug 23 04:32:52.523231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 389/745] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:52 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:32:52.732669 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8238e6-e045-42e6-9bf4-b97507719b1d", "name": "network-vif-deleted", "tag": "89b2c8bf-fcbd-46df-9d0d-0a4df470da86"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:52.744852 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.749582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.750861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.753720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "name": "network-vif-plugged", "status": "completed", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:52.767510 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] Creating event network-vif-deleted:89b2c8bf-fcbd-46df-9d0d-0a4df470da86 for instance cd8238e6-e045-42e6-9bf4-b97507719b1d on hv-cinder-85407 Aug 23 04:32:52.768763 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:52.769467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:52.770071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:52.778375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-1043cfaf-4b82-4b92-b97c-cf47f11b60d4 req-bc02a85e-a3e5-427f-9156-5f9e475a0485 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051026 Aug 23 04:32:52.779250 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 357/746] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:52.783498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] Creating event network-vif-plugged:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:32:52.793566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-c3f1fd60-e5a7-4f5e-b417-ed8b8d556c20 req-b5061b05-3d32-4ced-bc84-80d66f2ba2b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043395 Aug 23 04:32:52.794135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 390/747] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:53.163371 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:53.164674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:53.177705 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.178458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.179077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.181191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.182964 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.184243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.412719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:53.418971 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:53.419671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:53.423347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6753bd94-bf6f-4f52-9e92-e8fb937d9fe1 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.263619 Aug 23 04:32:53.424361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 358/748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:53 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:53.426756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.427300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.427793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.428585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.429161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.429637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.464627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.465393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.466136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.466868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lazy-loading 'fault' on Instance uuid cd8238e6-e045-42e6-9bf4-b97507719b1d {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:32:53.510979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b9a99be574eb8b09629988c4c59c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c113bdd75f254073abcfbd109dc7d187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:53.535814 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3c90160e-e0c5-42d3-b5cd-af3e528dff54 tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 200 len: 1312 microversion: 2.1 time: 0.117088 Aug 23 04:32:53.544072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 391/749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:53 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:53.546907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:53.547579 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:53.559272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.563031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.563698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.564531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:53.566749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:53.567408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:53.819622 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:53.833068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:53.834559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:53.835759 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d50c8dec-10df-4df4-b5f2-2fe113cc5631 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.293939 Aug 23 04:32:53.839946 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 359/750] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:53 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:54.421052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:54.423322 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:54.433138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.433622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.434052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.434754 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.435226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.435641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.446037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:54.447089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:54.467267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:54.470667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.471302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.471899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.472773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5860413b-f456-47b5-b9f9-9a406be6502a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055647 Aug 23 04:32:54.473413 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.473808 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 392/751] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:32:54 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:54.474233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.475200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.491375 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:54.492074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:54.498865 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.499970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.500779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.501633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.502279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.502844 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.562274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-542e2f51-39b8-4d1e-9fff-66b92043bb5a tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db" status: 200 len: 194 microversion: 2.1 time: 0.081237 Aug 23 04:32:54.571392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 393/752] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Aug 23 04:32:54 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:32:54.576781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:54.578100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] [instance: cd8238e6-e045-42e6-9bf4-b97507719b1d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:54.585490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.586382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.587668 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.588834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.589674 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.590346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.622911 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] HTTP exception thrown: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Request method failure captured: Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d HTTP/1.1 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc0ZcWOfD09VgBkNMQks-2q_GIo4BRXRof3RM6BbKzpwtDWywIRWIJeE1W8jipzNLnd-sKa4mPw54-poBJBHjDQ7HVOFy4SCgMCcm7yEYbJrtLqcQDBNnEe63Q4Ud7yu-miwuUchxy8MEN4VlfA0XCl8GQj4QsmrL02FxGDFljMWLg Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:32:54.624793 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c113bdd75f254073abcfbd109dc7d187", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c113bdd75f254073abcfbd109dc7d187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: c113bdd75f254073abcfbd109dc7d187 Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-580565846 Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 820b9a99be574eb8b09629988c4c59c0 Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-ServerRescueNegativeTestJSON-580565846-project Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. Aug 23 04:32:54.626032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'cd8238e6-e045-42e6-9bf4-b97507719b1d'} Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:32:54.626714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. Aug 23 04:32:54.627960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:32:54.628991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] Returning 404 to user: Instance cd8238e6-e045-42e6-9bf4-b97507719b1d could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:32:54.628991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-54923a55-71ab-465b-9f0a-266a0c2af26e tempest-ServerRescueNegativeTestJSON-580565846 tempest-ServerRescueNegativeTestJSON-580565846-project] 10.222.0.18 "GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d" status: 404 len: 111 microversion: 2.1 time: 0.053597 Aug 23 04:32:54.628991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 394/753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:54 2022] GET /compute/v2.1/servers/cd8238e6-e045-42e6-9bf4-b97507719b1d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:32:54.671608 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:54.683642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c305771b-761f-4f0d-a0b6-ab1a54c9308a tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.242639 Aug 23 04:32:54.697216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 360/754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:54 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:54.859269 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:54.860129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:54.871280 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.873643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.873915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.878003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.878580 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.880072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:54.956317 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1e9d26-fd17-41d4-abec-7355b833a3c0", "name": "network-vif-plugged", "status": "completed", "tag": "ec052b71-523a-46a8-82ad-e8f3b02837b2"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:54.960688 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=6 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:54.976020 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:54.980374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:54.982536 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:54.983188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:54.984398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:55.024017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] Creating event network-vif-plugged:ec052b71-523a-46a8-82ad-e8f3b02837b2 for instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 on hv-cinder-85407 Aug 23 04:32:55.035204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-3ee9e016-de89-48fc-98a3-b8e8f4d4ccbf req-ce6db6c9-81a8-4eae-8a33-670e0f11c4b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087212 Aug 23 04:32:55.043017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 361/755] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:55.156049 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:55.166737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:55.168724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:55.170197 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0b64c2a8-409d-4c97-bf6d-236b56839612 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.315417 Aug 23 04:32:55.186216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 395/756] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:54 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:55.705920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:55.706607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:55.717514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:55.718007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:55.718446 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:55.719163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:55.719610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:55.720055 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:55.877579 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:55.889967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ca2e14f2-b605-45d5-b4aa-cefbe6245f27 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1367 microversion: 2.1 time: 0.188341 Aug 23 04:32:55.890608 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 362/757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:55 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:32:56.111775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f7b700-7db3-4433-8286-32b6cfbfa1cf"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:56.115882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:56.122975 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.123570 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.124243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:56.125473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.126142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.126752 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:56.194416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:56.195238 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:56.202833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.206387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.206572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:56.210563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.217346 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.218216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:56.450327 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:56.458967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:56.467042 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:56.468278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-341b75e1-52ef-4b83-a26d-b500d5a1bd08 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.278637 Aug 23 04:32:56.471990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 363/758] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:56 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:56.921499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:56.926459 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:56.950279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.956743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.962395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:56.966059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:56.968929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:56.970098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:57.056782 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-825cefb4-d88f-4a17-a1f8-eed8aca6cd88 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "POST /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948818 Aug 23 04:32:57.057692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 396/759] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:32:56 2022] POST /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:57.226977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:57.240082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c6d0535c-f581-492b-b7f1-c237af40ae22 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1558 microversion: 2.1 time: 0.332316 Aug 23 04:32:57.240913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 364/760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:32:56 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1558 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:32:57.266271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:57.267772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:57.275155 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:57.275860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:57.276545 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:57.278009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:57.278641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:57.279228 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:57.306050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:57.397796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-061481e3-5a64-4ad3-8c16-fffa67565fbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136830 Aug 23 04:32:57.408364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 397/761] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Aug 23 04:32:57 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:32:57.495710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:57.497698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:57.508539 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:57.510487 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:57.512032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:57.513894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:57.514682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:57.515470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:58.097535 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:58.119502 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:58.124953 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:58.126675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c6f4098d-c656-4245-bff4-d6bc7b44b2bc tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.635942 Aug 23 04:32:58.129591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 365/762] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:57 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:32:59.157358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:32:59.159838 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:32:59.176248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:59.184309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:59.184766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:59.185509 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:59.185953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:59.186386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:59.265148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1e9d26-fd17-41d4-abec-7355b833a3c0", "tag": "ec052b71-523a-46a8-82ad-e8f3b02837b2"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:32:59.283031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:32:59.283877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:32:59.296571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:32:59.311550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] Creating event network-changed:ec052b71-523a-46a8-82ad-e8f3b02837b2 for instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 on hv-cinder-85407 Aug 23 04:32:59.334221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-8526ef6c-ba6a-4e99-a71c-8a25160d8122 req-9d662388-b684-48fe-8d23-1be2d9c12f54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176261 Aug 23 04:32:59.335424 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 366/763] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:32:59.465352 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:59.483317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:59.485170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:32:59.490178 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b0076187-9f0d-49b6-904d-93b681dfaa3d tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.343382 Aug 23 04:32:59.492765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 398/764] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:32:59 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:00.569151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:00.570499 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:00.580350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:00.581153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:00.581823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:00.582980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:00.583667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:00.584294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:00.808984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:00.828522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:00.830011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:00.831231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0bb98898-4384-4f78-bccb-5b1312265f66 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.274250 Aug 23 04:33:00.832391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 367/765] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:00 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:01.857250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:01.858497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:01.867421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:01.869122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:01.869711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:01.870626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:01.871061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:01.872309 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:02.046268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:02.059151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:02.061299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:02.062855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a11ef143-9a04-4c7a-9f12-f0bbbdb6e5ea tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.210817 Aug 23 04:33:02.063620 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 399/766] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:01 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:03.091681 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:03.093036 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:03.108469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:03.109337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:03.109853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:03.110881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:03.111575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:03.112191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:03.326932 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:03.336596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:03.338412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:03.339796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5b0f6fb1-7011-4f29-94b4-c3da07d3fff3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.255691 Aug 23 04:33:03.355391 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 368/767] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:03 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:04.364446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:04.365826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:04.374056 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:04.374640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:04.375299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:04.376099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:04.376698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:04.377737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:04.522260 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:04.534087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:04.534087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:04.534087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-226db695-1533-4a84-b37a-d4e505ad1627 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1738 microversion: 2.20 time: 0.174482 Aug 23 04:33:04.534619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 400/768] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:04 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:04.816180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:04.820563 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:04.828662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:04.829219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:04.829716 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:04.830665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:04.831309 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:04.831885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:04.864458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a5665a0f-aa9f-4918-b998-ba292966eaf9 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053547 Aug 23 04:33:04.865025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 369/769] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:33:04 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:05.005135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:05.005837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:05.011862 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.012395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.013036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.013728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.014335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.014761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.045536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d6b2d180-276a-4e7a-a93e-39b400d15962 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db" status: 200 len: 194 microversion: 2.1 time: 0.045092 Aug 23 04:33:05.046907 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 401/770] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Aug 23 04:33:04 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:05.057432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:05.058000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:05.065465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.066168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.066898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.068037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.068657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.069430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.160878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'services' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:05.253147 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7ce5ff96-fb38-4ae3-8ff1-b58348f8c326 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db" status: 202 len: 0 microversion: 2.1 time: 0.199903 Aug 23 04:33:05.254369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 370/771] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:33:05 2022] DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/417edd00-a109-468e-bca8-2d5be9aba9db => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:33:05.556813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:05.557409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:05.563422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.564047 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.564516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.565742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:05.566193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:05.566608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:05.775106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:05.783717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:05.785319 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:05.786555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f7f24b1a-0f51-49a4-b966-d032544b0a8f tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1720 microversion: 2.20 time: 0.234070 Aug 23 04:33:05.787172 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 402/772] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:05 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:06.815675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:06.816374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:06.824164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:06.824789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:06.825260 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:06.826097 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:06.826587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:06.827047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:06.849357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:06.973531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:06.983101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:06.984644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:06.985837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-62a4c738-1408-4475-bc6d-246dd9904dee tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1720 microversion: 2.20 time: 0.177374 Aug 23 04:33:06.986453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 371/773] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:06 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:08.008608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:08.009244 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:08.016015 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.016497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.016914 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.019731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.020227 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.020646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.167676 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:08.179372 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:08.181753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:08.183510 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6f1f4a2a-c544-4d9d-9014-df9793b59f43 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1663 microversion: 2.20 time: 0.178630 Aug 23 04:33:08.184385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 403/774] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:08 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:08.206838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d3d581-af01-4ae7-af30-ed0df50371e2"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:08.209281 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:08.216104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.216582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.217012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.217689 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.218134 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.218551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.526957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-091f3af0-a6ff-41c8-aaba-d89a75f2e11e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324083 Aug 23 04:33:08.528118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 372/775] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Aug 23 04:33:08 2022] POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 04:33:08.583741 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:08.584505 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:08.591745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.595442 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.596994 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.599383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.600268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.602228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.663629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-dfff008f-cf66-4889-be1e-30d2a0df1009 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/e0f7b700-7db3-4433-8286-32b6cfbfa1cf" status: 200 len: 194 microversion: 2.1 time: 0.084065 Aug 23 04:33:08.664834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 373/776] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Aug 23 04:33:08 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/e0f7b700-7db3-4433-8286-32b6cfbfa1cf => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:33:08.678161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:08.678861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:08.686067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.686823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.687252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.687952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.688498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.688808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.715219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "name": "network-vif-unplugged", "status": "completed", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:08.726288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.726762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.727184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.739083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.compute.server_external_events [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] Unable to find a host for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d. Dropping event network-vif-unplugged {{(pid=121223) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 04:33:08.740123 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-a5a101bb-31f5-4e0c-9ffa-3de33facb27e req-5e0215d1-b92b-4eda-8147-b46e1262c280 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.195591 Aug 23 04:33:08.740872 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 404/777] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 197 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 04:33:08.746788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:08.747470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:08.754346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.754832 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.755435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.756605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:08.757432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:08.758055 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:08.787641 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'services' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:08.897798 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e159a9e4-0f6c-446b-987c-61b69c6b6635 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/e0f7b700-7db3-4433-8286-32b6cfbfa1cf" status: 202 len: 0 microversion: 2.1 time: 0.226648 Aug 23 04:33:08.900864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 374/778] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:33:08 2022] DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments/e0f7b700-7db3-4433-8286-32b6cfbfa1cf => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:33:09.031326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-292220ae-f798-4ec5-8d7f-58646c21165e tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments/53d3d581-af01-4ae7-af30-ed0df50371e2" status: 202 len: 0 microversion: 2.20 time: 0.288899 Aug 23 04:33:09.032039 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 405/779] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Aug 23 04:33:08 2022] DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments/53d3d581-af01-4ae7-af30-ed0df50371e2 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:33:09.130877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:09.131553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:09.137733 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:09.138208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:09.138660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:09.139302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:09.139739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:09.140180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:09.188463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121224) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 04:33:09.273537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f3b39976-712c-4c69-97cc-7b1c308c73cf tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/action" status: 202 len: 0 microversion: 2.20 time: 0.147163 Aug 23 04:33:09.274216 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 375/780] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Aug 23 04:33:09 2022] POST /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 23 04:33:09.282346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:09.282941 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:09.290922 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:09.291399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:09.291822 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:09.292531 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:09.292968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:09.293380 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:09.463946 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:09.473633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:09.475426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:09.476623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-10bee069-bbc0-41d9-a571-17eae5dfccf5 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1671 microversion: 2.20 time: 0.198228 Aug 23 04:33:09.477156 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 406/781] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:09 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:10.502636 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:10.503272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:10.509818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:10.510296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:10.510713 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:10.511389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:10.511827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:10.512274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:10.650230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:10.659253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:10.660804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:10.661954 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5698f2e6-2128-43df-a170-d6002ff96035 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1671 microversion: 2.20 time: 0.166257 Aug 23 04:33:10.662549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 376/782] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:10 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:11.687718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:11.688604 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:11.698379 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:11.699054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:11.699662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:11.700664 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:11.701294 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:11.701882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:11.844637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:11.853424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:11.854925 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:11.856088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5f3bd281-0705-4f31-91b1-64d536244f0b tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1671 microversion: 2.20 time: 0.174054 Aug 23 04:33:11.856657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 407/783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:11 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:12.296522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:12.299944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:12.306965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.307670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.308350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.309231 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.309831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.310403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.343104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-64be8619-6607-45bc-b780-402b5aaebac3 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050777 Aug 23 04:33:12.343676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 377/784] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:33:12 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:33:12.476736 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:12.480221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:12.492117 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.493299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.495034 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.498284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.499391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.500040 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.536803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f148e3a7-4898-4c25-ac5c-96fdb6a20196 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065154 Aug 23 04:33:12.537502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 408/785] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:33:12 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:33:12.608351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:12.608842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:12.615680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.616419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.616851 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.617564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.618108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.618521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.648558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:33:12.736397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cab11b2d-12b4-422b-a4b0-f324b2897986 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 204 len: 0 microversion: 2.1 time: 0.131644 Aug 23 04:33:12.737268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 378/786] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:12 2022] DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:33:12.745498 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:12.746100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:12.752663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.753434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.753868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.754562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.755014 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.755426 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.880230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:12.881070 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:12.888369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.888867 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.889296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.889987 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:12.890095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:12.890545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:12.890883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:12.898900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-09a2024f-4ad4-4859-8fd0-af1d13cce8d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1674 microversion: 2.1 time: 0.157396 Aug 23 04:33:12.899470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 409/787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:12 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:33:13.028114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:13.040913 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:13.043228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:13.045115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-58d9172f-7d4e-4c2e-964f-11cb4d9206de tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.169888 Aug 23 04:33:13.045910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 379/788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:12 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:13.922021 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:13.922610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:13.930312 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:13.930785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:13.931207 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:13.932035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:13.932488 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:13.932950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:14.071369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:14.071984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:14.077336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:14.078966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:14.079452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:14.080002 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:14.080998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:14.081339 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:14.081784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:14.085823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0f0547f4-fb3d-4d72-b99a-fcf0a6760992 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1674 microversion: 2.1 time: 0.168589 Aug 23 04:33:14.086603 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 410/789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:13 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:14.551850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:14.561375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:14.563191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:14.564498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0dc42da3-12e8-40cb-9917-d208f164b8fd tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.497123 Aug 23 04:33:14.575956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 380/790] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:14 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:15.109337 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:15.111144 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:15.119077 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:15.119856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:15.121584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:15.122771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:15.123451 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:15.124753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:15.217438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:15.227982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a403f7f5-cee0-4cdf-a003-8f3d22a7e754 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1607 microversion: 2.1 time: 0.122858 Aug 23 04:33:15.230764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 411/791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:15 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1607 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:15.590352 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:15.591663 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:15.645155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:15.649093 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:15.653018 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:15.655302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:15.660715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:15.670850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:15.826904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6510fe12-9cc4-4920-af3c-738d3861a06b", "name": "network-vif-deleted", "tag": "cbb16d9f-5de1-4a2e-be50-a2f360416458"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:15.850768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:15.851718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:15.853330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:15.870717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] Creating event network-vif-deleted:cbb16d9f-5de1-4a2e-be50-a2f360416458 for instance 6510fe12-9cc4-4920-af3c-738d3861a06b on hv-cinder-85407 Aug 23 04:33:15.877692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-d11d8126-313a-47f1-a467-c3cc529995d8 req-81494111-7547-4b07-bb1c-f7de1c3247ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287321 Aug 23 04:33:15.879421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 412/792] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:16.089328 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:16.098534 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:16.100520 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:16.101728 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-26599385-8814-4482-8cdf-0323d0bda5fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.515887 Aug 23 04:33:16.112225 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 381/793] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:15 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:16.254212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:16.256274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:16.272176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:16.274370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:16.277222 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:16.278878 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:16.279459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:16.280030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:16.328876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:16.382323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:16.382799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:16.387641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:16.388487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:16.508968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:16.520861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4b36315a-95a6-45ef-a397-ec7aaf178c3c tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.272963 Aug 23 04:33:16.524054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 413/794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:16 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:17.128854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:17.130106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:17.155054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:17.156274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:17.157578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:17.160268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:17.161869 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:17.162449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:17.175619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:17.473748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:17.489171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:17.490682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:17.493240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0a7c7b3c-74c6-4b73-9698-3652c11275af tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.367841 Aug 23 04:33:17.493937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 382/795] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:17 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:17.546245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:17.546892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:17.557591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:17.558075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:17.558502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:17.559202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:17.559643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:17.568289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:17.635635 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:17.636160 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:17.636585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:17.637027 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:17.696150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:17.711633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-afde0e9e-c034-4c7c-9cfc-dd2d05725a49 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.169681 Aug 23 04:33:17.714184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 414/796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:17 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:18.518941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:18.520564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:18.527030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:18.527853 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:18.528760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:18.529666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:18.530712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:18.531340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:18.686114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:18.702312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:18.703804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:18.705073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d35557a0-f4f6-49d6-825a-af8c1b495558 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.190296 Aug 23 04:33:18.715031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 383/797] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:18 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:18.735379 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:18.736016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:18.744198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:18.746462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:18.747307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:18.748028 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:18.748916 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:18.749536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:18.750107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:18.791755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:18.792517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:18.793098 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:18.793695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:18.869853 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:18.878800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ca601e59-980d-4296-a1df-145abfe50cb6 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.147202 Aug 23 04:33:18.880176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 415/798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:18 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:19.728049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:19.728662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:19.737440 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:19.738257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:19.739150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:19.740392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:19.741395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:19.742468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:19.901278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:19.902005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:19.930843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:19.934530 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:19.940237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:19.941348 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:19.942084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:19.942816 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:19.945384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:19.956558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:19.958041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:19.965578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ae6273cd-8577-4f57-8d3a-3dfd8306e053 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.241875 Aug 23 04:33:19.973650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 384/799] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:19 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:20.021802 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:20.022279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:20.023061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:20.023833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:20.078111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:20.093847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-04b3e0b3-09be-45c1-ba52-e6af7287d9bc tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.197560 Aug 23 04:33:20.094858 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 416/800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:19 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:33:20.996884 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:20.998195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:21.006463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:21.007382 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:21.008226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:21.009030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:21.009538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:21.010013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:21.117842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:21.118412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:21.137288 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:21.138248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:21.138876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:21.139777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:21.140437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:21.141054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:21.179421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:21.180257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:21.181048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:21.181675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:21.202693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:21.213920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:21.217193 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:21.226683 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bcb67f4d-67b1-4b3c-9265-c29e86c30d31 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.233894 Aug 23 04:33:21.227690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 385/801] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:20 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:21.258889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:21.274135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-98d3c10f-3eb3-4375-bbda-e4e53f8d00de tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.161924 Aug 23 04:33:21.274785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 417/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:21 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:22.263766 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:22.264593 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:22.271483 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:22.272163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:22.272425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:22.273151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:22.273588 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:22.274009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:22.297368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:22.299879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:22.308359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:22.308838 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:22.309245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:22.310142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:22.310849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:22.311268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:22.351413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:22.352054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:22.352544 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:22.353055 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:22.404470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:22.413128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0dd26d34-bbb1-411d-b33b-b96d82baa2d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.122026 Aug 23 04:33:22.422024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 418/803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:22 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:33:22.467137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:22.476234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:22.477693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:22.478983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c0ceac4a-362c-4b0d-8d9f-d6968156b3f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.219327 Aug 23 04:33:22.479612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 386/804] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:22 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:23.434085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:23.434650 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:23.442074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:23.442440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:23.443077 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:23.443751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:23.444222 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:23.444630 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:23.478363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:23.478830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:23.479250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:23.479678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lazy-loading 'fault' on Instance uuid 6510fe12-9cc4-4920-af3c-738d3861a06b {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:23.502648 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:23.503315 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:23.510611 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:23.511063 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:23.511525 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:23.512245 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:23.512693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:23.513169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:23.524311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ce95360454ea1a96a22af310e5a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620abd3a734b4502afa795d2cc58dadf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:23.532733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e39d6fd1-b3a8-4d7f-8e09-a590759f10d0 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 200 len: 1327 microversion: 2.1 time: 0.102495 Aug 23 04:33:23.533303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 419/805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:23 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:23.650114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:23.659317 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:23.661549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:23.662758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-20da4baa-a524-46a8-a06b-69ccff78d7a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.164007 Aug 23 04:33:23.663319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 387/806] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:23 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:24.562320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:24.564739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:24.585133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:24.585947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:24.586554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:24.587452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:24.588112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:24.588700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:24.611955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b HTTP/1.1 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:24.613645 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:24.615263 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '6510fe12-9cc4-4920-af3c-738d3861a06b'} Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:24.616189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:24.617811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:24.619762 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:24.620748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1bbfc46a-6e56-458f-b696-a372cab859eb tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 404 len: 111 microversion: 2.1 time: 0.070451 Aug 23 04:33:24.621467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 420/807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:24 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:24.630428 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-299c4e76-87f1-4107-bd80-8c0d5ff60e6f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '.version_select at 0x7f9c16dfbdc0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:24.641514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:24.659151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-299c4e76-87f1-4107-bd80-8c0d5ff60e6f tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-312777414" status: 202 len: 0 microversion: 2.1 time: 0.032791 Aug 23 04:33:24.661425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 388/808] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Aug 23 04:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-312777414 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 04:33:24.690342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:24.690954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:24.698466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:24.699439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:24.700059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:24.701058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:24.702195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:24.702775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:24.889911 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:24.905433 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:24.907613 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:24.908786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ef7d6b3a-2163-4edd-8e43-686b73211ac7 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.226493 Aug 23 04:33:24.909896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 421/809] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:24 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:25.933738 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:25.934304 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:25.941305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:25.941794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:25.942438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:25.943054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:25.943493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:25.943904 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:26.085477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:26.093704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:26.095233 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:26.096425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-adf8657b-6598-4a0a-acde-b1f58b0d14a9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.167361 Aug 23 04:33:26.096992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 389/810] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:25 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:26.665137 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "name": "network-vif-plugged", "status": "completed", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:26.680652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:26.681563 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:26.682368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:26.696678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] Creating event network-vif-plugged:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:33:26.701781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-870ed9f3-6752-45ad-b1d8-e38dc9c02750 req-56cb23a4-f212-4a2d-86ff-ca633295a61e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041453 Aug 23 04:33:26.702416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 422/811] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:27.121578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:27.122304 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:27.128591 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.129157 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.129522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.130187 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.130630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.131038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.262484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:27.271493 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:27.273017 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:27.274181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c3515fba-70c4-41fa-982a-6b33e29149b8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.157329 Aug 23 04:33:27.274743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 390/812] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:27 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:27.653005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:27.653579 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:27.660223 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.660715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.661291 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.662007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.662458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.662875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.676487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b HTTP/1.1 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:27.678186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.679627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '6510fe12-9cc4-4920-af3c-738d3861a06b'} Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:27.680495 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.681703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.683090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:27.683090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-13fcb656-ea56-41b3-823e-3f5d723ebb56 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 404 len: 111 microversion: 2.1 time: 0.030816 Aug 23 04:33:27.683090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 423/813] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:27 2022] DELETE /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:27.689951 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:27.690675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: 6510fe12-9cc4-4920-af3c-738d3861a06b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:27.697449 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.697919 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.698342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.699012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:27.699452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:27.699863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:27.713844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b HTTP/1.1 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:27.715480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.717075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '6510fe12-9cc4-4920-af3c-738d3861a06b'} Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:27.717896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. Aug 23 04:33:27.719170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:27.720274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance 6510fe12-9cc4-4920-af3c-738d3861a06b could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:27.720274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-25e5da37-9ae2-406c-861c-b5fe8f15e673 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b" status: 404 len: 111 microversion: 2.1 time: 0.032548 Aug 23 04:33:27.720274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 391/814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:27 2022] GET /compute/v2.1/servers/6510fe12-9cc4-4920-af3c-738d3861a06b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:28.300488 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:28.301460 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:28.312423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.313559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.314331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.315452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.316771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.318063 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.474266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:28.482626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:28.484233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:28.485383 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-003bee2d-bf41-469f-a5a3-7722c93ceca8 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1729 microversion: 2.20 time: 0.191730 Aug 23 04:33:28.486037 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 424/815] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:28 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:28.867676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:28.868326 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:28.875841 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.876461 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.876949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.877716 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.878159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.878644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.893047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b HTTP/1.1 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:28.894678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.897732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'd37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b'} Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:28.899529 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.902066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.903545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:28.903545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-4a666897-a4f5-4fbb-8189-995570d8788b tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 404 len: 111 microversion: 2.1 time: 0.033025 Aug 23 04:33:28.903545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 392/816] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:28 2022] DELETE /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:28.905000 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:28.905641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] [instance: d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:28.911571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.912060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.912483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.913300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:28.913742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:28.914148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:28.927711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] HTTP exception thrown: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Request method failure captured: Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b HTTP/1.1 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcyVsfTdCrNUuImr303W6Zk5nyxyVkAjd8nDRjUxwjCsjh8ZakMFxBxG9Mz4_SRHeKK6WARrgXaW1IigZMBOLRAb30roBrOGjItHk2Qk_kKGO8l1TJEh4Nl67ToLV1GLMEjKemue_wUeD1iwB7VC1ORua44tHx2DGRrOjDMP8ICjC0 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:28.929622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_620abd3a734b4502afa795d2cc58dadf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/620abd3a734b4502afa795d2cc58dadf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 620abd3a734b4502afa795d2cc58dadf Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305138604 Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 658ce95360454ea1a96a22af310e5a4f Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeTestJSON-305138604-project Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.931065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'd37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b'} Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:28.935459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. Aug 23 04:33:28.936833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:28.938465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] Returning 404 to user: Instance d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:28.938465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-df7d0352-c7c3-4f7a-a242-bf99660bda54 tempest-AttachVolumeTestJSON-305138604 tempest-AttachVolumeTestJSON-305138604-project] 10.222.0.18 "GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b" status: 404 len: 111 microversion: 2.1 time: 0.030161 Aug 23 04:33:28.938465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 425/817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:28 2022] GET /compute/v2.1/servers/d37d6b72-97fb-4bfe-a0c5-8f10af9f7a0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:29.510331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:29.510920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:29.517115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:29.517596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:29.518095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:29.518779 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:29.519223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:29.519625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:29.651600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:29.659890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:29.661471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:29.662559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8351c8cd-9d47-4a5a-841d-db682e587298 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1716 microversion: 2.20 time: 0.156321 Aug 23 04:33:29.663354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 393/818] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:29 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:33:35.681639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:35.682686 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:35.691257 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:35.692007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:35.692437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:35.693134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:35.693577 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:35.694030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:35.717483 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b31efec8-0919-448e-8b8e-a192f9762057 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/ips" status: 200 len: 151 microversion: 2.1 time: 0.041403 Aug 23 04:33:35.718043 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 426/819] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Aug 23 04:33:35 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:37.112874 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20f235f8-c42e-4805-8abb-9353c1edf2e0"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:37.115210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:37.122939 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:37.123423 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:37.123850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:37.124578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:37.125021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:37.125438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:37.390712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3921b813-4d39-460e-80a5-fa47838d84eb tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "POST /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281597 Aug 23 04:33:37.391380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 394/820] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:33:37 2022] POST /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:44.015567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:44.016177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:44.022885 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:44.023386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:44.023806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:44.024523 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:44.024962 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:44.025461 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:44.124006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lazy-loading 'services' on Instance uuid bb1e9d26-fd17-41d4-abec-7355b833a3c0 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:33:44.206800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e54c5d42-dd6b-420c-988f-83844f411987 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments/20f235f8-c42e-4805-8abb-9353c1edf2e0" status: 202 len: 0 microversion: 2.1 time: 0.194951 Aug 23 04:33:44.207512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 427/821] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:33:44 2022] DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments/20f235f8-c42e-4805-8abb-9353c1edf2e0 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:33:44.216504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:44.218840 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:44.226719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:44.227544 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:44.229362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:44.230081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:44.230582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:44.231065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:44.266410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-99ce49e3-9beb-4f6e-8e92-b258f21bca2b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054196 Aug 23 04:33:44.267378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 395/822] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:33:44 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:45.281327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:45.283901 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:45.290441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.290938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.291847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.292775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.293346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.293918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.329759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-571aec56-035e-4f98-be17-57a674ef507d tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054423 Aug 23 04:33:45.330323 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 428/823] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:33:45 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 04:33:45.394931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:45.395488 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:45.402132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.402596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.403015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.403691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.404153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.404566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.429273 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:33:45.525490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1868025b-471f-4a53-b25e-c78487f93d00 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 204 len: 0 microversion: 2.1 time: 0.134917 Aug 23 04:33:45.526411 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 396/824] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:45 2022] DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 04:33:45.534590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:45.535200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:45.541485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.542084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.542503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.543334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:45.543767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:45.544214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:45.685096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:45.692859 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-72d1f0b0-f388-40a8-9083-986384050807 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1683 microversion: 2.1 time: 0.162288 Aug 23 04:33:45.693424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 429/825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:45 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:46.715348 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:46.716257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:46.722892 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:46.723365 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:46.723790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:46.724533 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:46.725289 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:46.725717 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:46.864075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:46.872158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-880f2638-81ef-4984-8b08-cd2841768830 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1683 microversion: 2.1 time: 0.161373 Aug 23 04:33:46.872789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 397/826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:46 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:47.893554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:47.894137 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:47.901088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:47.901855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:47.901855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:47.902556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:47.903011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:47.903423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:47.906143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:48.117328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91872508ecd49d98bd95651412f85a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ab946e7d0d4a5397945bfcbf49e723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:48.130225 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d611dc7f-5fc6-42d0-87a7-eb556d68c579 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 200 len: 1683 microversion: 2.1 time: 0.239140 Aug 23 04:33:48.131553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 430/827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:47 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 1683 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:48.407942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1e9d26-fd17-41d4-abec-7355b833a3c0", "name": "network-vif-deleted", "tag": "ec052b71-523a-46a8-82ad-e8f3b02837b2"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:33:48.435763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:48.436372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:48.436849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:48.470190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:48.477389 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] Creating event network-vif-deleted:ec052b71-523a-46a8-82ad-e8f3b02837b2 for instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 on hv-cinder-85407 Aug 23 04:33:48.492214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-6df05242-c4b0-4c43-b8e7-39ee9c39cb23 req-c17cc336-d4d9-40b0-b44d-a22fc662b17d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085050 Aug 23 04:33:48.493351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 398/828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:33:49.154553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:49.156607 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:49.167594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=42 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:49.170719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:49.171514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:49.172860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:49.174435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:49.175115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:49.175651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:49.193618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 HTTP/1.1 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:49.195839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:49.197582 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'bb1e9d26-fd17-41d4-abec-7355b833a3c0'} Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:49.198601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:49.200248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:49.201599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:49.201599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cec501a9-8f04-47e0-ac55-a41781b1584f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 404 len: 111 microversion: 2.1 time: 0.049905 Aug 23 04:33:49.202671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 431/829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:49 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:49.210807 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9b1d770a-7d5f-4dd8-abf1-3b64e2fa6dbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '.version_select at 0x7f9c16e27af0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:49.239767 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9b1d770a-7d5f-4dd8-abf1-3b64e2fa6dbd tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325908092" status: 202 len: 0 microversion: 2.1 time: 0.033145 Aug 23 04:33:49.240990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 399/830] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Aug 23 04:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325908092 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:33:51.104658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:51.105177 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:51.111625 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:51.112132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:51.112555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:51.113236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:51.113671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:51.114084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:51.127826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 HTTP/1.1 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:51.129364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.130850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'bb1e9d26-fd17-41d4-abec-7355b833a3c0'} Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:51.131821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.133811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.136110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:51.136110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9d232768-4424-4872-ba20-a24d2c3584d9 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 404 len: 111 microversion: 2.1 time: 0.030763 Aug 23 04:33:51.136110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 432/831] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:51 2022] DELETE /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:51.142430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:51.143198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: bb1e9d26-fd17-41d4-abec-7355b833a3c0] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:51.150551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:51.151344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:51.152253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:51.152941 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:51.153397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:51.153807 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:51.167812 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 HTTP/1.1 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:51.169451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.170897 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'bb1e9d26-fd17-41d4-abec-7355b833a3c0'} Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:51.171634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. Aug 23 04:33:51.172846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:51.173903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance bb1e9d26-fd17-41d4-abec-7355b833a3c0 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:51.173903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5c48735a-2eae-4f05-9dbc-20d39ab96a2f tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0" status: 404 len: 111 microversion: 2.1 time: 0.033341 Aug 23 04:33:51.173903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 400/832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:51 2022] GET /compute/v2.1/servers/bb1e9d26-fd17-41d4-abec-7355b833a3c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:52.315724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:52.316244 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:52.322948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.323512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.324086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.324781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.325221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.325637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.339246 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 HTTP/1.1 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:52.340852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.342307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '9c52f9ce-e7c8-4f79-a87f-ce45dadb8579'} Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:52.343154 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.344733 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.346230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:52.346230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4c0727ee-a64b-4c22-a79f-f0b7e239ebc3 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 404 len: 111 microversion: 2.1 time: 0.030389 Aug 23 04:33:52.346230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 433/833] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:52 2022] DELETE /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:52.351135 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:52.351755 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:52.358701 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.359181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.359625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.360342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.360796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.361215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.375750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 HTTP/1.1 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:52.377279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.378653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '9c52f9ce-e7c8-4f79-a87f-ce45dadb8579'} Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:52.379519 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. Aug 23 04:33:52.380899 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.382121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:52.382121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a6fed733-5b96-43fd-8b7f-707af9a16029 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579" status: 404 len: 111 microversion: 2.1 time: 0.031778 Aug 23 04:33:52.382121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 401/834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:52 2022] GET /compute/v2.1/servers/9c52f9ce-e7c8-4f79-a87f-ce45dadb8579 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:52.387209 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:52.387703 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:52.393692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.394168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.394597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.395268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.395708 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.396148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.409934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 HTTP/1.1 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:52.411502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.413070 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703'} Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:52.413882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.415113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.416394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:52.416394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-218839d1-956f-4257-94b5-95ff61588478 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 404 len: 111 microversion: 2.1 time: 0.029595 Aug 23 04:33:52.416394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 434/835] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:52 2022] DELETE /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:52.422291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:52.422900 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:52.429421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.429935 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.430361 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.431049 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:52.431492 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:52.431881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:52.446031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 HTTP/1.1 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:52.447498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.449143 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703'} Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:52.449924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. Aug 23 04:33:52.451376 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:52.452761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance 3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:52.452761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a14096d4-a2f0-45aa-b075-f8899ceaea9b tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703" status: 404 len: 111 microversion: 2.1 time: 0.030593 Aug 23 04:33:52.452761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 402/836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:52 2022] GET /compute/v2.1/servers/3b8cf4e4-66c7-4452-9ac2-8dd7e09a5703 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:53.603020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:53.603696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:53.610668 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:53.611148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:53.611576 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:53.612300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:53.612749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:53.613163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:53.627617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a HTTP/1.1 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:33:53.629193 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.630731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a'} Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:53.631526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.632779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.633983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:53.633983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5e0b1430-2446-45ff-91b3-2e4e5e9117e8 tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 404 len: 111 microversion: 2.1 time: 0.032459 Aug 23 04:33:53.633983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 435/837] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:33:53 2022] DELETE /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:53.649749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:53.650321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] [instance: e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:53.659885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:53.660598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:53.661200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:53.662170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:53.662822 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:53.663412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:53.678125 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] HTTP exception thrown: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Request method failure captured: Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a HTTP/1.1 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFc2suVWI7sNWHAu9h4DF4t1fscV6lVlOO-PZqrJQTAfZ3LEqulOHpoAjZqrpHkTBdZiFl8ljylbnvAp0apRpX9g5p1C1kKKAavH93pEyLSkA5rZ2tAJrFZrMgKZW3YlGMYhQv3bjz2KbvJUMgf-hX1Ae5K9zD74MMLF02byCju6dfo Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:33:53.679623 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52ab946e7d0d4a5397945bfcbf49e723", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52ab946e7d0d4a5397945bfcbf49e723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 52ab946e7d0d4a5397945bfcbf49e723 Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470492174 Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: a91872508ecd49d98bd95651412f85a2 Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeNegativeTest-470492174-project Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.681208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a'} Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:33:53.681977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. Aug 23 04:33:53.683720 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:33:53.685025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] Returning 404 to user: Instance e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:33:53.685025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3d544331-7117-45a3-93f0-a3d57db4f3ac tempest-AttachVolumeNegativeTest-470492174 tempest-AttachVolumeNegativeTest-470492174-project] 10.222.0.18 "GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a" status: 404 len: 111 microversion: 2.1 time: 0.037331 Aug 23 04:33:53.685025 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 403/838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:33:53 2022] GET /compute/v2.1/servers/e69ff3c7-a6a0-417a-80dd-4113eb8a8d4a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:58.424030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:58.426718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:58.434877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.435345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.435766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.436557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.436996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.437402 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.485011 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f28f6127-ed18-4af3-9ac8-c8ff36861a97 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064951 Aug 23 04:33:58.485769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 436/839] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Aug 23 04:33:58 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:33:58.550626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:58.551118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:58.556690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:58.558574 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.559046 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.559464 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.560171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.560613 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.561024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.590190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:33:58.673890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d23e816a-8926-4798-9077-600437bff69a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 204 len: 0 microversion: 2.20 time: 0.126937 Aug 23 04:33:58.674685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 404/840] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Aug 23 04:33:58 2022] DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 04:33:58.684917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:58.685566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:58.692300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.692772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.693200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.693905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:58.694677 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:58.695085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:58.835968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:58.845608 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:58.847215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:33:58.848473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-96a21655-5197-428a-9fb6-0e34b615a3fe tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.168530 Aug 23 04:33:58.849145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 437/841] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:58 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:33:59.872525 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:33:59.873212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:33:59.879868 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:59.880344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:59.880782 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:33:59.881437 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:33:59.881921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:33:59.882349 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:00.023846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:00.033549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:00.035374 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:00.036603 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6612769e-df2d-4af7-90a0-6d24ab963908 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1722 microversion: 2.20 time: 0.168640 Aug 23 04:34:00.037322 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 405/842] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:33:59 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 04:34:00.888491 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fa23cb-802d-4f77-a8e8-1186afbb359d", "name": "network-vif-deleted", "tag": "2ff7de56-3ec6-4615-a0a4-667797f15a84"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:34:00.905964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:00.906646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:00.907213 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:00.924966 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] Creating event network-vif-deleted:2ff7de56-3ec6-4615-a0a4-667797f15a84 for instance 23fa23cb-802d-4f77-a8e8-1186afbb359d on hv-cinder-85407 Aug 23 04:34:00.934107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-0faffc63-93e2-478e-87d7-eac437b20750 req-0214a75e-1700-45fe-955c-0eae6bdde506 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048923 Aug 23 04:34:00.942088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 438/843] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:01.065172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:01.067280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:01.080507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:01.081995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:01.086709 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:01.090806 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:01.091451 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:01.092229 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:01.208173 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:01.216041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:01.217509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:01.218125 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lazy-loading 'fault' on Instance uuid 23fa23cb-802d-4f77-a8e8-1186afbb359d {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:34:01.289452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:01.298227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:01.300045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa0859e5c14c53a5a2473c95efe152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6589185abe4af1b3d0cba6f0699538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:34:01.301749 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-00c8c930-63ce-4259-826d-34b45e910bb3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 200 len: 1371 microversion: 2.20 time: 0.245239 Aug 23 04:34:01.302733 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 406/844] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:34:01 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 04:34:02.327267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:02.327942 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:02.334348 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:02.334823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:02.335240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:02.335937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:02.336400 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:02.336812 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:02.351792 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d HTTP/1.1 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:34:02.353548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:02.355185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '23fa23cb-802d-4f77-a8e8-1186afbb359d'} Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:34:02.356393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:02.357949 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:02.359176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:34:02.359176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d27f6405-4b72-4063-8b2a-f5cfaf3db9ed tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 404 len: 111 microversion: 2.20 time: 0.032678 Aug 23 04:34:02.359176 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 439/845] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:34:02 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:34:02.365185 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c5dd2461-db03-499b-a5b9-ca9beb197cb9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '.version_select at 0x7f9c16dff940>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:02.386282 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c5dd2461-db03-499b-a5b9-ca9beb197cb9 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247280138" status: 204 len: 0 microversion: 2.20 time: 0.024679 Aug 23 04:34:02.386871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 407/846] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Aug 23 04:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247280138 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 04:34:04.232973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:04.233623 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:04.240510 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:04.241268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:04.241701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:04.242395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:04.242976 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:04.243390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:04.258299 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d HTTP/1.1 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:34:04.259936 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.262096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '23fa23cb-802d-4f77-a8e8-1186afbb359d'} Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:34:04.262937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.264315 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.265709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:34:04.265709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-818266ba-6267-4607-aaca-2e52e22e46f0 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 404 len: 111 microversion: 2.20 time: 0.034108 Aug 23 04:34:04.265709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 440/847] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Aug 23 04:34:04 2022] DELETE /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:34:04.271047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:04.271662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: 23fa23cb-802d-4f77-a8e8-1186afbb359d] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:04.278392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:04.278868 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:04.279498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:04.280196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:04.280635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:04.281047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:04.294836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d HTTP/1.1 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:34:04.296661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.298354 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '23fa23cb-802d-4f77-a8e8-1186afbb359d'} Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:34:04.299264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. Aug 23 04:34:04.300775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:04.301815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance 23fa23cb-802d-4f77-a8e8-1186afbb359d could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:34:04.301815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0773642e-b253-4e59-98cc-12e912fb9aa3 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d" status: 404 len: 111 microversion: 2.20 time: 0.031586 Aug 23 04:34:04.301815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 408/848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:34:04 2022] GET /compute/v2.1/servers/23fa23cb-802d-4f77-a8e8-1186afbb359d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 04:34:05.465349 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:05.465874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:05.474316 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:05.474767 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:05.475493 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:05.476190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:05.476626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:05.477033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:05.491672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 HTTP/1.1 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:34:05.493272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.495111 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'c0da9656-e0b8-4a68-9062-f3abc68d75f8'} Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:34:05.496099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.497343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.498542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:34:05.498542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-94df15b7-c3cc-4ba8-977e-c415f9ed4317 tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 404 len: 111 microversion: 2.20 time: 0.033750 Aug 23 04:34:05.498542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 441/849] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Aug 23 04:34:05 2022] DELETE /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:34:05.504221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:05.504827 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] [instance: c0da9656-e0b8-4a68-9062-f3abc68d75f8] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:34:05.511240 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:05.511675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:05.512140 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:05.512820 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:34:05.513262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:34:05.513672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:34:05.527316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] HTTP exception thrown: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Request method failure captured: Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 HTTP/1.1 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFcs8oLDmId70ZTw2TJlcQd2Tyri_t7Qu9MlhVgQKpr74E-2z7QyHNrqOEsuWoko4TIuuPUFQJiCIl5JGeJI8gXdYj7O99q1N6EVL2mcZ9bhazPBtU3KIaUmwi86ZHdrnRzMvWJx0IGkq8WEMs8Gb_aIMyJT9GQHxzSAz3tTuBlcvpE Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:34:05.529060 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa6589185abe4af1b3d0cba6f0699538", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa6589185abe4af1b3d0cba6f0699538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: fa6589185abe4af1b3d0cba6f0699538 Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1269833824 Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: c8fa0859e5c14c53a5a2473c95efe152 Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1269833824-project Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.530626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'c0da9656-e0b8-4a68-9062-f3abc68d75f8'} Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:34:05.531825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. Aug 23 04:34:05.533306 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:34:05.534562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] Returning 404 to user: Instance c0da9656-e0b8-4a68-9062-f3abc68d75f8 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:34:05.534562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-79318e4a-62ea-4302-bf14-7aa45900559a tempest-AttachVolumeShelveTestJSON-1269833824 tempest-AttachVolumeShelveTestJSON-1269833824-project] 10.222.0.18 "GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8" status: 404 len: 111 microversion: 2.20 time: 0.030212 Aug 23 04:34:05.534562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 409/850] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Aug 23 04:34:05 2022] GET /compute/v2.1/servers/c0da9656-e0b8-4a68-9062-f3abc68d75f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 04:34:11.937771 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4ea6e6ca-3856-4203-8be8-5d6fa8e0b836 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16e0fb80>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:11.990595 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4ea6e6ca-3856-4203-8be8-5d6fa8e0b836 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1b38be3e-eafa-480a-989c-68ad31acb4a5" status: 200 len: 350 microversion: 2.1 time: 0.057370 Aug 23 04:34:11.991256 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 442/851] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:34:11 2022] GET /compute/v2.1/os-volumes/1b38be3e-eafa-480a-989c-68ad31acb4a5 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:13.370836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-869230cf-ac2e-4cbd-8a15-64683a2dcf89 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16e27940>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:13.421814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-869230cf-ac2e-4cbd-8a15-64683a2dcf89 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/dde83b33-ee9f-424e-8d4e-2ee0d0d1e794" status: 200 len: 350 microversion: 2.1 time: 0.055392 Aug 23 04:34:13.422350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 410/852] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:34:13 2022] GET /compute/v2.1/os-volumes/dde83b33-ee9f-424e-8d4e-2ee0d0d1e794 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:14.804084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7fa1b48b-1341-4dbd-b6ef-524da2eec2c4 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16db6dc0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:14.856276 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7fa1b48b-1341-4dbd-b6ef-524da2eec2c4 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da6696bf-000e-4047-a6a7-d76b4e818d7f" status: 200 len: 350 microversion: 2.1 time: 0.056614 Aug 23 04:34:14.856884 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 443/853] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Aug 23 04:34:14 2022] GET /compute/v2.1/os-volumes/da6696bf-000e-4047-a6a7-d76b4e818d7f => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:14.870469 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2e5a7cf5-b88b-4f97-a22b-9c5fcf4b8e90 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16df7a60>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:14.963300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2e5a7cf5-b88b-4f97-a22b-9c5fcf4b8e90 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.097406 Aug 23 04:34:14.963870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 411/854] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Aug 23 04:34:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:34:14.979216 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-67168116-1c06-41cf-8503-db46968cb80f tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16dd48b0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.063174 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-67168116-1c06-41cf-8503-db46968cb80f tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088423 Aug 23 04:34:15.063890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 444/855] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Aug 23 04:34:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:15.079967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a15aa942-f0b3-4d71-9237-ee677f1c21eb tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16e27310>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.164834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a15aa942-f0b3-4d71-9237-ee677f1c21eb tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091448 Aug 23 04:34:15.165398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 412/856] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:34:15.184522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-90779302-370d-48ff-a268-2e9817a91648 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16e6d9d0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.271490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-90779302-370d-48ff-a268-2e9817a91648 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093261 Aug 23 04:34:15.272074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 445/857] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:15.285850 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ae2e2d5b-d646-4880-a999-bb3abd87f9d8 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16dffe50>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.380560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ae2e2d5b-d646-4880-a999-bb3abd87f9d8 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098613 Aug 23 04:34:15.381463 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 413/858] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:15.396691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-31b7ecb6-e98e-45a3-99da-4be82b78712c tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16dde160>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.473054 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=21 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:15.483151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-31b7ecb6-e98e-45a3-99da-4be82b78712c tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.090233 Aug 23 04:34:15.483746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 446/859] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:34:15.496881 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bc5d71dc-c597-474c-ab1c-1101bf108e75 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16dfb0d0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.508619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:15.518115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:15.580387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bc5d71dc-c597-474c-ab1c-1101bf108e75 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087181 Aug 23 04:34:15.581065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 414/860] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:34:15.591521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=35 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:15.597430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0dc421f6-a78f-42a2-854c-b4f872d86820 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] Calling method '.version_select at 0x7f9c16db6550>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:34:15.688428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0dc421f6-a78f-42a2-854c-b4f872d86820 tempest-VolumesTestJSON-1755034551 tempest-VolumesTestJSON-1755034551-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.098126 Aug 23 04:34:15.689115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 447/861] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Aug 23 04:34:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:35:51.344887 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:35:51.345593 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:35:56.687132 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:35:56.687676 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:36:08.172774 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e27f9b35-25d8-4178-9c4f-361f3d34882e] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 04:36:08.406886 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-59b58ad7-c92a-4f1c-9c12-49e121e52da7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Action: 'create', calling method: .version_select at 0x7f9c16e124c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1987449574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmXwJZxFS4KeKPaSqZjw1hxI+L8Dg3LSV4ZDuhjWzFjRoLvTwQJ/d3obSnkZzV7c7GuHJHLqnGfuW1lX2QPeW8IrbzjDi9lAsHZvBzezmiLO47fAncx7CE7Bv2EnoCmAQ=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:08.428751 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-59b58ad7-c92a-4f1c-9c12-49e121e52da7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Getting quotas for project 0fa7aa0063804717a00a59ea3e188779. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:36:08.433823 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-59b58ad7-c92a-4f1c-9c12-49e121e52da7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Getting quotas for user 6a7ac4048d0646f78c0d813fa0112a83 and project 0fa7aa0063804717a00a59ea3e188779. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:36:08.462252 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-59b58ad7-c92a-4f1c-9c12-49e121e52da7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.291313 Aug 23 04:36:08.464082 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 415/862] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:36:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:11.368915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b6330f0-7b12-4a66-bf5b-f5283a93f86f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 04:36:11.380434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1779447031", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "networks": [{"uuid": "3bcd867e-334f-43fe-81c1-c3b25b710cc1"}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:11.460655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] validate_networks() for [('3bcd867e-334f-43fe-81c1-c3b25b710cc1', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:36:11.892567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:36:11.893007 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:36:11.893485 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:36:11.893892 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:36:11.894371 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:36:11.903435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:11.903902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:11.904357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:11.905058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:11.905497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:11.905905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:11.923036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Getting quotas for project e749692b9683425791f92baca207aa04. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:36:11.927043 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Getting quotas for user 2e1a8096652a43049a0512c7922c1cc1 and project e749692b9683425791f92baca207aa04. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:36:11.938270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:36:11.940640 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:36:11.988456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-68bfc3ca-8dce-4662-b5ec-4801695a6af8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621228 Aug 23 04:36:11.989456 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 448/863] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:36:12.002883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-39f2ca78-df34-43e2-b22b-db9b787d71a0 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:12.003639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-39f2ca78-df34-43e2-b22b-db9b787d71a0 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:12.015674 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] [e27f9b35-25d8-4178-9c4f-361f3d34882e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40214. Aug 23 04:36:12.067765 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-39f2ca78-df34-43e2-b22b-db9b787d71a0 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:12.075059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-39f2ca78-df34-43e2-b22b-db9b787d71a0 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1214 microversion: 2.1 time: 0.078880 Aug 23 04:36:12.075624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 416/864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:11 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:13.099134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:13.100116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:13.111207 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:13.111689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:13.112163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:13.112868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:13.113336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:13.113747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:13.114380 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b6330f0-7b12-4a66-bf5b-f5283a93f86f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40232. Aug 23 04:36:13.183904 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:13.191841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fa34c6b7-8960-45ec-bc82-9712916d5f12 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1266 microversion: 2.1 time: 0.098759 Aug 23 04:36:13.192469 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 449/865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:13 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:14.213828 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:14.214630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:14.222387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:14.223002 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:14.224073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:14.224806 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:14.225251 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:14.225697 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:14.368220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:14.377504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-49b964ff-640a-46c5-a063-8f5acff31dfa tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.167670 Aug 23 04:36:14.378708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 417/866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:14 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:14.632505 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad3bbee-1711-4f10-8589-63d141ec9ec3", "tag": "140ba774-add8-468f-9774-ee72fc542904"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:14.647611 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:14.648812 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:14.649296 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:14.661794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] Creating event network-changed:140ba774-add8-468f-9774-ee72fc542904 for instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 on hv-cinder-85407 Aug 23 04:36:14.667243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-c71b00b2-d415-47b9-916d-69960dfcfcf0 req-6164ef8b-185e-4a7c-9101-9e40321c3d82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039549 Aug 23 04:36:14.668094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 450/867] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:15.403468 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:15.404503 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:15.416248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:15.417114 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:15.417619 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:15.418394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:15.418839 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:15.419786 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:15.561414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:15.569403 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-95505070-afe6-4cd8-8848-83c753e9535d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.172474 Aug 23 04:36:15.569958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 418/868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:15 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:16.592465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:16.593029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:16.600783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:16.601310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:16.602084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:16.602847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:16.603425 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:16.603891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:16.740561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:16.749353 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-44256e29-310f-457d-828b-49cc88fcedc8 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.162319 Aug 23 04:36:16.749926 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 451/869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:16 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:17.770644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:17.771189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:17.778521 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:17.778998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:17.779419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:17.780128 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:17.780573 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:17.780983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:17.920222 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:17.928168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-08fd21b5-5a04-41c9-83f5-7f66d0d1edf5 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.161491 Aug 23 04:36:17.928762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 419/870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:17 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:18.950116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:18.950756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:18.957633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:18.958130 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:18.958556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:18.959250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:18.959698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:18.960147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:19.103905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:19.112225 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a3387082-9e0b-40e5-b50d-184191335998 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.166955 Aug 23 04:36:19.112827 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 452/871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:18 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:19.577652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad3bbee-1711-4f10-8589-63d141ec9ec3", "name": "network-vif-plugged", "status": "completed", "tag": "140ba774-add8-468f-9774-ee72fc542904"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:19.589099 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:19.589616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:19.590041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:19.601875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] Creating event network-vif-plugged:140ba774-add8-468f-9774-ee72fc542904 for instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 on hv-cinder-85407 Aug 23 04:36:19.605426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR oslo.messaging._drivers.impl_rabbit [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] [adb0599e-12b4-4f6c-924b-58d0a3faa5f9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 04:36:20.137727 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:20.138490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:20.147099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:20.147732 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:20.148345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:20.149254 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:20.149855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:20.150612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:20.293127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:20.301121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3cc5b62e-496c-462a-b563-73508afaee6c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.170072 Aug 23 04:36:20.301689 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 453/872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:20 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:20.615337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] [adb0599e-12b4-4f6c-924b-58d0a3faa5f9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40280. Aug 23 04:36:20.621708 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-c709bfb2-e635-47f9-8f16-4f9ddab04065 req-26e0cde4-a019-492b-b69e-b267767a7225 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.047695 Aug 23 04:36:20.622592 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 420/873] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:21.329264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:21.329970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:21.338424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:21.339020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:21.339554 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:21.340454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:21.341012 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:21.341533 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:21.485212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:21.492930 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-292509e3-f958-4b9c-94fd-d165a8304caf tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1314 microversion: 2.1 time: 0.168695 Aug 23 04:36:21.493744 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 454/874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:21 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:22.512375 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:22.517722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:22.518626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:22.526948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:22.527417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:22.527837 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:22.528552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:22.528990 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:22.529397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:22.672207 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:22.680234 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6ce0a9f1-1846-468c-9f98-57951f35c681 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1498 microversion: 2.1 time: 0.169844 Aug 23 04:36:22.680763 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 421/875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:22 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:23.085669 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:23.086189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:23.088469 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:23.089126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=6 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:23.095338 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:23.095935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:23.096379 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:23.097046 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:23.097482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:23.097889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:23.123539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:36:23.208003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-28edc9d8-ac73-41bc-a6e1-0036dcad2570 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 204 len: 0 microversion: 2.1 time: 0.125820 Aug 23 04:36:23.208557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 455/876] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:36:23 2022] DELETE /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:36:23.217698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:23.218309 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:23.224290 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:23.224764 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:23.225189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:23.225910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:23.226659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:23.227071 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:23.362562 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:23.371162 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0e61c67b-e287-4822-920f-096ce474d541 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1504 microversion: 2.1 time: 0.157271 Aug 23 04:36:23.371735 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 422/877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:23 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:24.269566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1775903856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1987449574", "security_groups": [{"name": "tempest-secgroup-smoke-1066952490"}], "networks": [{"uuid": "fd1b268e-c3c8-4e3e-a5f1-d05062dc1214"}], "block_device_mapping_v2": [{"uuid": "1da1cd98-298d-40d7-9b11-fa60ce5b81c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:24.393050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:24.393666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:24.400408 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:24.400911 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:24.401470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:24.402278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:24.402752 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:24.403170 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:24.410138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] validate_networks() for [('fd1b268e-c3c8-4e3e-a5f1-d05062dc1214', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:36:24.618186 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:24.627116 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-82f26646-e5fc-4295-9f06-780cad8e84a9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 200 len: 1504 microversion: 2.1 time: 0.237794 Aug 23 04:36:24.627782 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 423/878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:24 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:24.877694 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:36:24.878005 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:36:24.878412 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:36:24.878837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:36:24.879248 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:36:24.888628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:24.889096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:24.889520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:24.890272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:24.890714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:24.891118 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:24.907955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Getting quotas for project 0fa7aa0063804717a00a59ea3e188779. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:36:24.912060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Getting quotas for user 6a7ac4048d0646f78c0d813fa0112a83 and project 0fa7aa0063804717a00a59ea3e188779. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:36:24.978538 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:36:24.980797 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1da1cd98-298d-40d7-9b11-fa60ce5b81c3',volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:36:25.034080 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad3bbee-1711-4f10-8589-63d141ec9ec3", "name": "network-vif-deleted", "tag": "140ba774-add8-468f-9774-ee72fc542904"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:25.045572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:25.046296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:25.046711 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:25.059821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] Creating event network-vif-deleted:140ba774-add8-468f-9774-ee72fc542904 for instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 on hv-cinder-85407 Aug 23 04:36:25.066062 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-14cff097-3a60-4d0e-8be7-0a303184474e req-8ccf111c-669f-4801-bac2-9e61961da061 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035594 Aug 23 04:36:25.067086 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 424/879] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:36:25.124559 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0272a75e-ec8b-48aa-9e9e-8c7c286015c7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861601 Aug 23 04:36:25.125507 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 456/880] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:36:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:36:25.136489 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7e7626a8-cdb1-42df-86f7-d8196352bc05 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:25.137303 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7e7626a8-cdb1-42df-86f7-d8196352bc05 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:25.201860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7e7626a8-cdb1-42df-86f7-d8196352bc05 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:25.209715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7e7626a8-cdb1-42df-86f7-d8196352bc05 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1089 microversion: 2.1 time: 0.077516 Aug 23 04:36:25.210433 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 425/881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:25 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:25.648918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:25.649532 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: 2ad3bbee-1711-4f10-8589-63d141ec9ec3] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:25.655959 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:25.656452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:25.656932 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:25.657754 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:25.658207 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:25.658739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:25.679081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] HTTP exception thrown: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Request method failure captured: Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 HTTP/1.1 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFk5Jqd3hTVGX_9xNrV2JX5tWKek7FIoqaCvXlQ2fQx1fIn6mZ1ivueV7i90c-Nfvo6ShwiaG5irFHxO_3mMUYaoIBIZtPxRHVOELW7TOgIyGynXtHDLAdPjyV9y2ts-a9QkCtwYuL8wUNgzNP_YNnYT59_H-LUHmw5qLrF85XK-Q5Y Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: e749692b9683425791f92baca207aa04 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:36:25.682145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e749692b9683425791f92baca207aa04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e749692b9683425791f92baca207aa04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e749692b9683425791f92baca207aa04", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e749692b9683425791f92baca207aa04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: e749692b9683425791f92baca207aa04 Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-VolumesActionsTest-1667717484-project Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 2e1a8096652a43049a0512c7922c1cc1 Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-VolumesActionsTest-1667717484-project Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. Aug 23 04:36:25.684121 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': '2ad3bbee-1711-4f10-8589-63d141ec9ec3'} Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:36:25.685023 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. Aug 23 04:36:25.686266 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:36:25.687428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Returning 404 to user: Instance 2ad3bbee-1711-4f10-8589-63d141ec9ec3 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:36:25.687428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-65b9fa7f-532a-42c3-8f3e-5686c18f4b79 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3" status: 404 len: 111 microversion: 2.1 time: 0.039538 Aug 23 04:36:25.687428 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 457/882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:25 2022] GET /compute/v2.1/servers/2ad3bbee-1711-4f10-8589-63d141ec9ec3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 04:36:25.735261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-864352888", "imageRef": "7d6ae938-5ae0-4856-aae2-2f586e3233ef", "flavorRef": "452", "networks": [{"uuid": "3bcd867e-334f-43fe-81c1-c3b25b710cc1"}]}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:25.794189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] validate_networks() for [('3bcd867e-334f-43fe-81c1-c3b25b710cc1', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:36:26.231393 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:26.232057 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:26.239032 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:26.239753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:26.240523 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:26.241806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:26.242430 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:26.243231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:26.320126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:26.328970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ec62efae-351c-44fa-8448-64d71f35d50f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1205 microversion: 2.1 time: 0.102632 Aug 23 04:36:26.329745 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 458/883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:26 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:36:26.461974 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:36:26.462515 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:36:26.463054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:36:26.463357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:36:26.463758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:36:26.473810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:26.474256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:26.474925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:26.475639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:26.476123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:26.476842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:26.494084 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Getting quotas for project e749692b9683425791f92baca207aa04. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:36:26.498156 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Getting quotas for user 2e1a8096652a43049a0512c7922c1cc1 and project e749692b9683425791f92baca207aa04. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:36:26.509395 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:36:26.511687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d6ae938-5ae0-4856-aae2-2f586e3233ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:36:26.567264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f51fdc6f-bd5d-4497-bb0d-190e12a6b92e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836417 Aug 23 04:36:26.568973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 426/884] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:36:26.583569 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-71337bac-9b5d-4e9b-a0f0-7d4f37da724d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:26.584798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-71337bac-9b5d-4e9b-a0f0-7d4f37da724d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:26.648566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-71337bac-9b5d-4e9b-a0f0-7d4f37da724d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:26.657714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-71337bac-9b5d-4e9b-a0f0-7d4f37da724d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1213 microversion: 2.1 time: 0.081143 Aug 23 04:36:26.660303 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 459/885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:26 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:27.349978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:27.350701 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:27.359098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:27.359656 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:27.360417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:27.361151 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:27.361757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:27.362607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:27.513571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:27.521696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5331da4e-078d-429c-adcd-128a2047fa10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.176181 Aug 23 04:36:27.522340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 427/886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:27 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:27.604591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:27.614831 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:27.615287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:27.615706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:27.631947 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] Creating event network-changed:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:36:27.638758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-30128610-6c19-4352-bf7c-931ba28f655b req-f64104b7-1373-41ca-a52e-0a47ccbdc3d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040022 Aug 23 04:36:27.639410 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 460/887] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:27.680369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:27.681103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:27.687406 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:27.688144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:27.688938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:27.689800 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:27.690416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:27.690979 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:27.780184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:27.795001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e542facf-1531-4d94-a4ed-c12f7e83d6ed tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1265 microversion: 2.1 time: 0.118699 Aug 23 04:36:27.796228 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 428/888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:27 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:28.548473 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:28.549641 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:28.558837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:28.559320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:28.559750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:28.560476 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:28.560928 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:28.561434 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:28.767946 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:28.776492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3f3b26b6-3a25-4245-bac3-4db0b9cefb80 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.235755 Aug 23 04:36:28.777065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 461/889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:28 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:28.815808 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:28.816435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:28.823219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:28.823696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:28.824338 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:28.825023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:28.825514 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:28.825880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:29.037905 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:29.046937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0069f864-9235-4b84-be80-4f7600dad42c tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.234939 Aug 23 04:36:29.047516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 429/890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:28 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:29.324134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc45348-e399-494b-8130-3f91e372fbad", "tag": "de4dfded-e097-4b6b-a4ea-e6de8cc8db59"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:29.334168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:29.334755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:29.335258 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:29.346957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] Creating event network-changed:de4dfded-e097-4b6b-a4ea-e6de8cc8db59 for instance fcc45348-e399-494b-8130-3f91e372fbad on hv-cinder-85407 Aug 23 04:36:29.352567 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-9282c236-5deb-4385-aa5a-faf5ec523081 req-e38b06b5-a92c-4863-b46c-6d48e1d3f180 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032364 Aug 23 04:36:29.353159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 462/891] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:29.798876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:29.799471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:29.805644 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:29.806200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:29.806657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:29.807342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:29.807796 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:29.808267 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:29.946490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:29.954668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e9706807-cc24-415e-8245-e002d02dda7c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.159760 Aug 23 04:36:29.955300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 430/892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:29 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:30.072129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:30.072700 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:30.079272 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:30.079747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:30.080208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:30.080912 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:30.081362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:30.081780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:30.215794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:30.223629 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0d09896f-dc83-4527-a7d3-edb80c4438b9 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.156805 Aug 23 04:36:30.224230 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 463/893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:30 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:30.978940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:30.979533 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:30.987345 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:30.987982 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:30.988736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:30.989531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:30.990067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:30.990633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:31.166314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:31.174172 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c20bbf8a-727d-4e8c-a413-482781eee63f tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.199474 Aug 23 04:36:31.174737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 431/894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:30 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:31.247328 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:31.248080 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:31.257609 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:31.258305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:31.259147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:31.259758 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:31.260242 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:31.260664 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:31.406073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:31.417592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2d5cde2c-5f2e-40f3-b36a-3e97512fef47 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.175895 Aug 23 04:36:31.418152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 464/895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:31 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:32.198394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:32.199008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:32.205810 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:32.206288 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:32.206714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:32.207394 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:32.207838 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:32.208292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:32.349732 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:32.359685 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-118ef2af-df5b-4fd4-807f-bdcb2f054762 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.166983 Aug 23 04:36:32.360350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 432/896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:32 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:32.449437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:32.450158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:32.464081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:32.464081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:32.464081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:32.464081 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:32.465058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:32.465058 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:32.595842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:32.604324 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3d5af3bb-efbd-4f0b-9e37-8755b0b62fd7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.161654 Aug 23 04:36:32.604894 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 465/897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:32 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:33.384908 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:33.385527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:33.392551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:33.393028 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:33.393450 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:33.394120 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:33.394564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:33.394981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:33.532091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:33.540351 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f916b2b7-8087-428f-b452-fef67dae261d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.161699 Aug 23 04:36:33.541041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 433/898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:33 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:33.625494 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:33.626091 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:33.633107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:33.633598 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:33.634167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:33.635133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:33.635516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:33.635948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:33.753762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc45348-e399-494b-8130-3f91e372fbad", "name": "network-vif-plugged", "status": "completed", "tag": "de4dfded-e097-4b6b-a4ea-e6de8cc8db59"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:33.765342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:33.765830 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:33.766241 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:33.778104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] Creating event network-vif-plugged:de4dfded-e097-4b6b-a4ea-e6de8cc8db59 for instance fcc45348-e399-494b-8130-3f91e372fbad on hv-cinder-85407 Aug 23 04:36:33.779597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:33.783665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-33c36dc0-bba9-4d03-983e-1a976b617756 req-d1ed8d8e-b12f-4655-be0a-f8811cb56e78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034632 Aug 23 04:36:33.784790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 434/899] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:33.787661 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cb80b4b2-480a-45b2-8cd4-2e9c25e304e7 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.166231 Aug 23 04:36:33.788279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 466/900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:33 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:34.567737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:34.568958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:34.580225 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:34.580962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:34.581715 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:34.582855 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:34.583761 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:34.584548 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:34.721815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:34.730122 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-75d46b75-8c30-4ee7-8afd-21b6e0805bdd tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.170476 Aug 23 04:36:34.730661 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 435/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:34 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:34.812235 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:34.813072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:34.822683 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:34.823147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:34.823566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:34.824279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:34.824718 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:34.825124 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:34.898731 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:34.956419 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:34.961289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:34.967637 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2e43ed0c-e434-4378-93c9-c8215710bd93 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1313 microversion: 2.1 time: 0.161639 Aug 23 04:36:34.968237 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 467/902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:34 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:35.751005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:35.751626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:35.758180 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:35.758675 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:35.759153 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:35.759854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:35.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:35.760760 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:35.991852 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:35.995681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:35.996701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:36.006341 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-10d264e6-334f-4d11-bc4f-1f72650967d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.259217 Aug 23 04:36:36.025605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.026087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.026512 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:36.027202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.028087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.028087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:36.031635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 436/903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:35 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:36.247446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:36.257781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-773ed4fc-b3ac-4223-a78b-26aa5c5d249d tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1497 microversion: 2.1 time: 0.271915 Aug 23 04:36:36.258712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 468/904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:35 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1497 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:36.772925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:36.773479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:36.775880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:36.776752 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=8 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:36.784851 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.785337 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.785836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:36.786571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.786961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.787369 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:36.791992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=100 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:36.820549 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:36:36.918454 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8b51f357-3768-4bf4-8ea7-bc85fc314e5e tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 204 len: 0 microversion: 2.1 time: 0.149094 Aug 23 04:36:36.919175 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 437/905] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:36:36 2022] DELETE /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:36:36.929289 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:36.929931 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:36.931901 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=8 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:36.937184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.937662 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.938092 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:36.938775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:36.939219 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:36.939634 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:37.028047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:37.028834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:37.035171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:37.035659 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:37.036155 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:37.036903 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:37.037300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:37.037737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:37.076876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:37.085205 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-16df35d3-786b-41d1-bd7a-3244eb276b1b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1503 microversion: 2.1 time: 0.159776 Aug 23 04:36:37.085803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 469/906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:36 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:37.178048 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:37.186978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b8f74b1f-c24f-483b-99f3-bc4fe8d93339 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.163301 Aug 23 04:36:37.187542 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 438/907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:37 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:37.639642 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "name": "network-vif-plugged", "status": "completed", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:37.649683 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:37.650141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:37.650717 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:37.662158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] Creating event network-vif-plugged:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:36:37.667709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-15571cca-f379-4866-8f22-073a72567db0 req-b53a4402-2c25-472e-bdfb-7dafdb5c43c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Aug 23 04:36:37.668311 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 470/908] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:38.106163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:38.107532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:38.116524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:38.117001 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:38.117426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:38.118404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:38.118970 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:38.119387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:38.212305 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:38.213087 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:38.219431 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:38.219931 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:38.220419 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:38.221116 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:38.221551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:38.221964 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:38.326624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:38.336571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3c5acb8a-fe74-499a-860f-905a1e5342a1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1503 microversion: 2.1 time: 0.234579 Aug 23 04:36:38.337795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 439/909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:38 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:38.398868 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:38.406853 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-bade714f-bf7d-4bc2-8b7e-db943c416131 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1261 microversion: 2.1 time: 0.199722 Aug 23 04:36:38.407417 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 471/910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:38 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:38.712547 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc45348-e399-494b-8130-3f91e372fbad", "name": "network-vif-deleted", "tag": "de4dfded-e097-4b6b-a4ea-e6de8cc8db59"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:38.717384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:38.723269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:38.723742 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:38.724195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:38.737764 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] Creating event network-vif-deleted:de4dfded-e097-4b6b-a4ea-e6de8cc8db59 for instance fcc45348-e399-494b-8130-3f91e372fbad on hv-cinder-85407 Aug 23 04:36:38.742728 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-6bb36885-84f1-43dc-b10e-5f4ceb59174a req-402c1237-fc03-4675-8379-278b2a1e678c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 Aug 23 04:36:38.743657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 440/911] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:36:39.360985 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:39.361880 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:39.369735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.370210 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.370785 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.371668 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.372133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.372561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.408497 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.408969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.409391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.409823 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lazy-loading 'fault' on Instance uuid fcc45348-e399-494b-8130-3f91e372fbad {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:36:39.427532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:39.428230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:39.435038 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.435517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.435952 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.436647 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.437095 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.437511 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.453820 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1a8096652a43049a0512c7922c1cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749692b9683425791f92baca207aa04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:39.463261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1bfba56a-c577-4c7b-990a-e67540951e3b tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 200 len: 1303 microversion: 2.1 time: 0.105958 Aug 23 04:36:39.463786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 472/912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:39 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:39.568323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:39.576582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-429716ba-87e6-451e-af79-5fc483e67656 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1444 microversion: 2.1 time: 0.153305 Aug 23 04:36:39.577148 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 441/913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:39 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:39.596671 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:39.597278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:39.604365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.604843 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.605270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.605950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:39.606394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:39.606806 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:39.753826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:36:39.763009 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7f5266f0-af8a-49cb-b897-09d3e07eee2b tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1444 microversion: 2.1 time: 0.170137 Aug 23 04:36:39.763667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 473/914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:39 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:36:40.484865 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:36:40.485512 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] [instance: fcc45348-e399-494b-8130-3f91e372fbad] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:36:40.492630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:40.493291 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:40.494342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:40.495053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:40.495500 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:40.495930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:40.511722 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] HTTP exception thrown: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Request method failure captured: Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad HTTP/1.1 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFk5Jqd3hTVGX_9xNrV2JX5tWKek7FIoqaCvXlQ2fQx1fIn6mZ1ivueV7i90c-Nfvo6ShwiaG5irFHxO_3mMUYaoIBIZtPxRHVOELW7TOgIyGynXtHDLAdPjyV9y2ts-a9QkCtwYuL8wUNgzNP_YNnYT59_H-LUHmw5qLrF85XK-Q5Y Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: e749692b9683425791f92baca207aa04 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:36:40.513447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e749692b9683425791f92baca207aa04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e749692b9683425791f92baca207aa04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e749692b9683425791f92baca207aa04", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e749692b9683425791f92baca207aa04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: e749692b9683425791f92baca207aa04 Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-VolumesActionsTest-1667717484 Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-VolumesActionsTest-1667717484-project Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 2e1a8096652a43049a0512c7922c1cc1 Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-VolumesActionsTest-1667717484-project Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. Aug 23 04:36:40.515179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'fcc45348-e399-494b-8130-3f91e372fbad'} Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:36:40.516491 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. Aug 23 04:36:40.517943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:36:40.519115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] Returning 404 to user: Instance fcc45348-e399-494b-8130-3f91e372fbad could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:36:40.519115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3a3a18b9-83c8-47eb-aad2-153995688fb1 tempest-VolumesActionsTest-1667717484 tempest-VolumesActionsTest-1667717484-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad" status: 404 len: 111 microversion: 2.1 time: 0.033931 Aug 23 04:36:40.519115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 442/915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:36:40 2022] GET /compute/v2.1/servers/fcc45348-e399-494b-8130-3f91e372fbad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:36:41.764578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:36:41.769833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:36:41.776033 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:36:41.776509 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:36:41.776926 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:36:41.791959 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] Creating event network-changed:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:36:41.797038 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-21de3513-ba94-481d-9b14-6dae986eb1ce req-b8f83e08-c81f-42c7-b90f-71e45f704a8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036071 Aug 23 04:36:41.797711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 474/916] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:21.076278 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7e76e46e-a90b-4faa-905d-630e8f54a4f9 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'create', calling method: .version_select at 0x7f9c16dffdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-287717041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3IR5TLnARfM2KnKm+fpnVSfOaL5tNbjeZCrO/Lqf1KZW2xdCfFeI/pRkn3Mwu8pWUKo8jaN+E4p+U5c5cwN8MVoatmBEyi3VkjG5p05h+kPDie84mbTM1rhGy/T+lcaQ=="}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:21.081801 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=5 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:21.082434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:21.095141 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-7e76e46e-a90b-4faa-905d-630e8f54a4f9 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Getting quotas for project 0111954f3e6e430387495701fa502227. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:37:21.099421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-7e76e46e-a90b-4faa-905d-630e8f54a4f9 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Getting quotas for user 7c1f40a97d2e42668e18961b8fd8a065 and project 0111954f3e6e430387495701fa502227. Resources: {'key_pairs'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:37:21.122638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7e76e46e-a90b-4faa-905d-630e8f54a4f9 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050417 Aug 23 04:37:21.123220 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 443/917] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:37:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:21.172970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=36 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:21.173692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:21.178076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1365642058", "imageRef": "e28c8081-0434-40c0-8885-66869d5552b6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-287717041", "networks": [{"uuid": "3eceae04-29ba-4baa-8af3-6a722cb418b1"}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:21.229973 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] validate_networks() for [('3eceae04-29ba-4baa-8af3-6a722cb418b1', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:37:21.645459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:37:21.646030 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:37:21.646761 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:37:21.647340 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:37:21.647817 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:37:21.658370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:21.658839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:21.659264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:21.660020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:21.660461 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:21.660864 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:21.678517 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Getting quotas for project 0111954f3e6e430387495701fa502227. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:37:21.682751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Getting quotas for user 7c1f40a97d2e42668e18961b8fd8a065 and project 0111954f3e6e430387495701fa502227. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:37:21.694043 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:37:21.696420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e28c8081-0434-40c0-8885-66869d5552b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:37:21.750988 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fdcd98bd-e0d2-45f0-af17-aa41ffbec0bc tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579864 Aug 23 04:37:21.751626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 475/918] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:37:21.762527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-11618ef6-cf98-4ac8-a4f9-fb41c8480fa6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:21.763137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-11618ef6-cf98-4ac8-a4f9-fb41c8480fa6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:21.823104 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-11618ef6-cf98-4ac8-a4f9-fb41c8480fa6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:21.830256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-11618ef6-cf98-4ac8-a4f9-fb41c8480fa6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1258 microversion: 2.1 time: 0.071752 Aug 23 04:37:21.830817 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 444/919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:21 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:37:22.852395 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:22.853819 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:22.861232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:22.861728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:22.862165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:22.862854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:22.863295 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:22.863695 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:22.930939 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:22.938814 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-05bd4f9a-39ea-4e47-be17-3721af084758 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1316 microversion: 2.1 time: 0.091836 Aug 23 04:37:22.939377 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 476/920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:22 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:23.960214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:23.960954 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:23.975066 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:23.977254 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:23.977961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:23.978912 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:23.979581 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:23.980258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:24.126610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:24.134736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b292ceeb-2210-4df2-b804-0c9ba44b3039 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.178590 Aug 23 04:37:24.135313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 445/921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:23 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:25.155026 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:25.155611 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:25.162180 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:25.162652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:25.163072 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:25.163944 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:25.164612 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:25.165028 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:25.474336 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:25.482877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-62fbb29d-c1b3-4ea7-a2b9-dbb23ad52062 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.331739 Aug 23 04:37:25.483443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 477/922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:25 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:26.504867 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:26.505576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:26.512541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:26.513015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:26.513435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:26.514118 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:26.514558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:26.514976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:26.655834 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:26.664620 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9165ac63-4f7b-48ff-ba8a-06b6c2b29fac tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.163289 Aug 23 04:37:26.665937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 446/923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:26 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:27.692370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:27.692982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:27.705190 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:27.705675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:27.706099 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:27.706816 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:27.707240 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:27.707835 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:27.852633 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:27.860167 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-51c084cd-2835-4612-9a43-331dd3e9d967 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.171728 Aug 23 04:37:27.860943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 478/924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:27 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:28.880655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:28.881338 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:28.888435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:28.888922 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:28.889405 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:28.890119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:28.890550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:28.890967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:29.094743 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:29.104077 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8fc4510c-461d-4210-a104-6c6c2de4c4c7 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.227352 Aug 23 04:37:29.104966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 447/925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:28 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:30.125142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:30.125739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:30.132653 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:30.133127 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:30.133639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:30.134321 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:30.134766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:30.135204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:30.281250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:30.291981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-faaf3a2a-ddf3-49bd-89a5-60517f5f4316 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.170829 Aug 23 04:37:30.292586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 479/926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:30 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:31.072350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:31.088456 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:31.088872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:31.089300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:31.100912 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] Creating event network-changed:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:37:31.106065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-a73fa6f0-29a7-4632-8b15-98415560bfd8 req-e31cca03-0a30-449f-9362-c1694f98efe5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037575 Aug 23 04:37:31.107032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 448/927] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:31.313085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:31.313749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:31.320906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:31.321735 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:31.322492 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:31.323505 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:31.324017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:31.324441 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:31.456297 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:31.461432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c7235423-735e-4470-be62-db1d4dd08a0f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.152314 Aug 23 04:37:31.462188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 480/928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:31 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:32.481223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:32.486214 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:32.486893 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:32.493678 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:32.494152 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:32.494575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:32.495258 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:32.495699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:32.496136 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:32.631130 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:32.639085 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1fba6509-d14a-4ea5-8934-c56c39ea4530 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.158866 Aug 23 04:37:32.639643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 449/929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:32 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:33.660458 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:33.661647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:33.663549 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:33.664233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=6 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:33.670706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:33.671182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:33.671601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:33.672421 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:33.672742 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:33.673152 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:33.812295 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:33.820016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1515294a-1aed-4bd7-b2c5-f41e9d848ae2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.163646 Aug 23 04:37:33.820581 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 481/930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:33 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:34.846672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:34.847269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:34.859008 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:34.859509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:34.859956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:34.860702 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:34.861169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:34.861600 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:35.004793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:35.013067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d6831218-fb85-4490-9e20-9f69252818c0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.174731 Aug 23 04:37:35.013907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 450/931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:34 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:36.037614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:36.038189 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:36.045076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:36.045566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:36.045992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:36.046687 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:36.047136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:36.047555 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:36.183110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:36.191397 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7a1e613e-9bdb-4cbe-a0ab-6606bdc5ee1f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.157689 Aug 23 04:37:36.191940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 482/932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:36 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:36.288051 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "name": "network-vif-plugged", "status": "completed", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:36.298167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:36.298670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:36.299085 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:36.311167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] Creating event network-vif-plugged:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:37:36.316498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-32e30ac1-4c85-4316-bc66-07985321bca5 req-0b589526-08c6-43ef-9c3f-e636c33cf501 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 Aug 23 04:37:36.317293 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 451/933] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:37.215737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:37.216726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:37.228871 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:37.229651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:37.230503 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:37.231626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:37.232409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:37.233100 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:37.376342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:37.384585 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-220458b2-f76e-4129-824f-70626d3af167 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1358 microversion: 2.1 time: 0.175742 Aug 23 04:37:37.385151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 483/934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:37 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:38.407223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:38.407972 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:38.415342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.415794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.416318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.416996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.417435 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.417844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.551647 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:38.562447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-26308d3f-faff-4481-b95f-f3ea15b78b90 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1549 microversion: 2.1 time: 0.160310 Aug 23 04:37:38.566360 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 452/935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:38 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:38.585140 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:38.585693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:38.592917 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.593392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.593810 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.594487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.594924 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.595330 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.740182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:38.748343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-39bb3db7-4f8c-4dc1-93cf-e79eed4c8d65 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1549 microversion: 2.1 time: 0.167102 Aug 23 04:37:38.748876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 484/936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:38 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:38.767653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:38.772308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:38.773067 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Searching by: {'deleted': False, 'project_id': '0111954f3e6e430387495701fa502227'} {{(pid=121224) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 04:37:38.780030 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.780508 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.780945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.781666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:38.782167 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:38.782568 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:38.871142 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.multi_cell_list [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121224) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 04:37:39.119602 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-63d74841-2d7c-403d-85e7-d1f2547ffde5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.355608 Aug 23 04:37:39.120184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 453/937] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Aug 23 04:37:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:39.136591 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:39.137198 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:39.143520 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:39.144019 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:39.144431 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:39.145128 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:39.145571 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:39.145987 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:39.288770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:39.296891 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ad3c6aac-4a9a-4a37-affd-5ce7d389651b tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1549 microversion: 2.1 time: 0.165020 Aug 23 04:37:39.297459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 485/938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:39 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:40.886279 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f135a786-b261-4939-8b7a-ca47d5f8a431"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:40.888602 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:40.895218 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:40.895690 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:40.896145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:40.896819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:40.897256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:40.897686 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:41.150144 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9a2806d0-dd86-4be5-9a24-5cb5932d9bc5 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267325 Aug 23 04:37:41.150753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 454/939] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Aug 23 04:37:40 2022] POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:47.726719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:47.727432 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:47.736749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:47.737463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:47.738085 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:47.739079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:47.739741 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:47.740461 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:47.886803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:47.895561 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-1c56f420-623d-4ab2-b281-07e9ebd203e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1595 microversion: 2.1 time: 0.175583 Aug 23 04:37:47.896161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 486/940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:47 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1595 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:37:49.566814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:49.571000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:49.582195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:49.582667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:49.583089 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:49.594821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] Creating event network-changed:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:37:49.600042 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-f43e34bd-ec5a-4182-93d1-50087e552bf2 req-5b747d4b-45f5-4de7-96e6-a01f7459de12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034462 Aug 23 04:37:49.601126 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 455/941] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:50.707737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-849481228"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:50.708385 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:50.716343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:50.716861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:50.717300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:50.717992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:50.718438 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:50.718854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:50.846707 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.network.security_group_api [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Adding security group 9e5f276d-a191-429d-bbf6-3c4012ca3ac4 to port 2213fa9a-5e72-4595-84d3-73ed7c74d8ca Aug 23 04:37:51.185989 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f13854a6-bff9-45b3-89fb-251b6ef9ef81 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action" status: 202 len: 0 microversion: 2.1 time: 0.482754 Aug 23 04:37:51.186690 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 487/942] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:37:50 2022] POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:37:51.193668 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:37:51.197344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:37:51.197344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:37:51.198233 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:51.204913 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:51.205278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:51.205699 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:51.206751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:51.207392 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:51.207979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:51.213968 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:51.216976 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=73 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:51.218032 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:37:51.219181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:37:51.219750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:37:51.235795 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:51.239121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] Creating event network-changed:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:37:51.247707 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-c6a14610-4d81-4c71-8c8c-53aa93c9c5b6 req-1afbd230-1873-4c46-80d7-1538b5c6f829 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057950 Aug 23 04:37:51.248960 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 456/943] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:37:51.374006 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:37:51.384779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cfdbb815-a8b7-48db-aa1d-c5b246cdea8d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1760 microversion: 2.1 time: 0.193770 Aug 23 04:37:51.385274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 488/944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:37:51 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:08.425319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:08.427908 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:08.437016 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:08.437536 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:08.437969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:08.438665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:08.439110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:08.439520 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:08.518006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2945d4d2-f1a4-4bc9-8b02-d36739294387 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action" status: 202 len: 0 microversion: 2.1 time: 0.098563 Aug 23 04:38:08.518618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 457/945] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:38:08 2022] POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:38:08.529038 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:08.529725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:08.532267 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:08.533113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=5 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:08.539424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:08.539953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:08.540443 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:08.541226 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:08.541777 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:08.542256 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:08.699899 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:08.708397 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-0e173f2a-f439-489f-aa6f-5ec120a87c0d tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1752 microversion: 2.1 time: 0.184607 Aug 23 04:38:08.709355 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 489/946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:08 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:09.730848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:09.731452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:09.738340 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:09.738818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:09.739269 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:09.739896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:09.740401 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:09.740818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:09.894007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:09.904660 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5ff8927b-4dbc-4333-a021-8dad9a4346e1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.178699 Aug 23 04:38:09.905224 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 458/947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:09 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:10.930655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:10.931618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:10.942655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:10.943445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:10.944206 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:10.945346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:10.946092 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:10.946787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:11.124594 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:11.136720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-49406ede-cac2-48bf-a632-8b54e1b2d9b8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.212609 Aug 23 04:38:11.137286 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 490/948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:10 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:12.162002 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:12.162993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:12.173396 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:12.174181 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:12.174883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:12.175997 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:12.176773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:12.177458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:12.331274 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:12.343773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3ccd227b-b611-4887-924f-8c6623b744b0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.187908 Aug 23 04:38:12.344540 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 459/949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:12 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:13.366097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:13.366655 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:13.373206 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:13.373658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:13.374109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:13.374788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:13.375236 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:13.375646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:13.786985 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:13.797513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-fb708d3b-556f-45cd-8aad-b4666addef44 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.435627 Aug 23 04:38:13.798112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 491/950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:13 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:14.819123 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:14.819783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:14.827103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:14.827578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:14.828037 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:14.828712 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:14.829150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:14.829559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:14.976940 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:14.985639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-5a4fcfa8-78aa-4c85-943a-01dc670b9c52 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.170514 Aug 23 04:38:14.986191 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 460/951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:14 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:16.010308 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:16.011525 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:16.023035 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:16.023826 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:16.024583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:16.025709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:16.026632 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:16.026769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:16.182194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:16.190915 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f5e44cf3-9f3c-4856-8e5c-6c9d1fb24d7f tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.187093 Aug 23 04:38:16.191467 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 492/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:16 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:17.212652 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:17.213305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:17.220184 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:17.220657 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:17.221081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:17.221757 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:17.222208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:17.222610 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:17.367793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:17.377242 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-8f90cc3d-ef12-40f1-9f1e-fde3a175dcfa tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.168530 Aug 23 04:38:17.377784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 461/953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:17 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:18.403020 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:18.404125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:18.414769 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:18.415551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:18.416320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:18.417278 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:18.417743 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:18.418151 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:18.574778 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:18.583048 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-cf843d20-5d80-42e5-9869-0232e36768a8 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.186247 Aug 23 04:38:18.583616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 493/954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:18 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:19.608567 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:19.609561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:19.621194 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:19.621467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:19.621901 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:19.622572 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:19.623013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:19.623423 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:19.771073 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:19.779587 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b84e170c-991f-4513-b65b-895151c675d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1757 microversion: 2.1 time: 0.177918 Aug 23 04:38:19.780168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 462/955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:19 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:20.800600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:20.801181 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:20.808359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:20.808872 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:20.809304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:20.809991 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:20.810437 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:20.810856 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:20.963293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:20.971728 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-66bf2d99-86a2-438e-bd91-ec4e7baefa19 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1760 microversion: 2.1 time: 0.175201 Aug 23 04:38:20.972306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 494/956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:20 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:39.017642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:39.018892 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:39.023176 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=13 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:39.024296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:39.031650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:39.032158 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:39.032583 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:39.033266 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:39.033707 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:39.034121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:39.058616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lazy-loading 'flavor' on Instance uuid c4e91829-1333-46b6-8b6f-b3b57faa0098 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:38:39.149264 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a2df9b48-7f25-4673-9484-6a69063bae93 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "POST /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098/action" status: 202 len: 0 microversion: 2.1 time: 0.138630 Aug 23 04:38:39.149995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 463/957] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:38:39 2022] POST /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:38:39.158475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:39.159084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:39.161714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=12 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:39.162472 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=36 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:39.168984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:39.169799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:39.169950 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:39.170574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:39.171180 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:39.171605 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:39.313097 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:39.324415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d9fbf5be-85e3-475e-890f-b13115295351 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.169842 Aug 23 04:38:39.325088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 495/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:39 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:40.346407 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:40.347050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:40.355381 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:40.355849 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:40.356320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:40.357007 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:40.357453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:40.357864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:40.502137 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:40.510108 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-16e9a925-88fb-4e36-bff6-5fcda2f15b65 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.168176 Aug 23 04:38:40.510754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 464/959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:40 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:41.538059 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:41.539382 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:41.547597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:41.548124 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:41.548556 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:41.549270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:41.549759 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:41.550301 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:41.697547 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:41.705992 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7400f83c-f9f6-4dd8-848a-56a718db87f7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.174780 Aug 23 04:38:41.706562 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 496/960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:41 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:42.733133 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:42.733978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:42.744789 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:42.745412 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:42.745872 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:42.746553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:42.746999 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:42.747417 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:42.890068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:42.902541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-04df0068-f85a-49e1-924d-1223ada3b6d3 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.177464 Aug 23 04:38:42.903112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 465/961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:42 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:43.924489 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:43.925125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:43.932631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:43.933217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:43.933738 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:43.934575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:43.935119 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:43.935610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:44.076940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:44.085522 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3ef9dc9d-be2d-43d0-a18b-1a6aa91716b4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.165890 Aug 23 04:38:44.086088 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 497/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:43 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:45.118199 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:45.119197 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:45.126910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:45.127390 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:45.127816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:45.128579 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:45.129029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:45.129446 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:45.289344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:45.297976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-43f40bfc-c1af-4f85-8f6e-1e5a737ef03d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.186328 Aug 23 04:38:45.298537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 466/963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:45 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:46.324104 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:46.324711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:46.331714 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:46.332214 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:46.332643 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:46.333326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:46.333779 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:46.334194 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:46.473357 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:46.482008 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-5351021e-b6e2-462e-bfe6-1c751dd3c6d5 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.164834 Aug 23 04:38:46.482578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 498/964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:46 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:47.506614 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:47.507523 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:47.515680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:47.516215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:47.516643 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:47.517323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:47.517774 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:47.518219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:47.652320 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:47.664296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-7be44257-9792-4f09-a4a6-db5555db8cd2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.164306 Aug 23 04:38:47.665005 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 467/965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:47 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:48.689937 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:48.690890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:48.701945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:48.702724 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:48.703423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:48.704578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:48.705332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:48.706018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:48.867446 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:48.878765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-15ba48fb-eacd-4316-b79d-04defbf8bce6 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.195453 Aug 23 04:38:48.879367 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 499/966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:48 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:49.900998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:49.901641 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:49.908414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:49.908895 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:49.909321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:49.910013 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:49.910457 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:49.910873 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:50.051342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:50.063794 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-79722cc9-1d09-4055-94d2-c7d35e04f939 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.166298 Aug 23 04:38:50.064476 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 468/967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:49 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:51.091279 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:51.091952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:51.099208 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:51.100065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:51.100515 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:51.101231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:51.101698 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:51.102136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:51.245521 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:51.253363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6975ebe6-4acf-414e-aafe-0c4cb97e1a17 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.167908 Aug 23 04:38:51.253910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 500/968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:51 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:52.274748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:52.275380 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:52.282272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.282748 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.283169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.283851 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.284332 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.284753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.426345 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:52.434742 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-0df18948-bb87-4dc0-9ac0-637d20cbda61 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1510 microversion: 2.1 time: 0.164010 Aug 23 04:38:52.435301 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 469/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:52 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:52.455274 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:52.455952 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:52.462811 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.463482 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.464089 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.464841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.465284 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.465693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.495069 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121223) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 04:38:52.569928 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-dede8f14-d452-4c61-b4b1-ed637eef35d2 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "POST /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098/action" status: 202 len: 0 microversion: 2.1 time: 0.118231 Aug 23 04:38:52.570439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 501/970] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:38:52 2022] POST /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:38:52.579115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:52.579721 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:52.585710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.586196 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.586624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.587311 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:52.587756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:52.588199 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:52.727942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:52.736029 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-59b12065-408c-4169-a5fa-8c0433254f16 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1518 microversion: 2.1 time: 0.160747 Aug 23 04:38:52.736561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 470/971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:52 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:53.298948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-849481228"}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:53.299631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:53.308618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:53.309401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:53.310096 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:53.311017 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:53.311712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:53.312416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:53.446639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.network.security_group_api [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Removing security group 9e5f276d-a191-429d-bbf6-3c4012ca3ac4 from port 2213fa9a-5e72-4595-84d3-73ed7c74d8ca Aug 23 04:38:53.759371 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:53.760128 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:53.768975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:53.769467 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:53.769888 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:53.770816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:53.771009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:53.771602 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:53.772261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2ed9fa85-fa6d-4a64-98d7-2839b192aced tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action" status: 202 len: 0 microversion: 2.1 time: 0.479980 Aug 23 04:38:53.773071 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 502/972] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Aug 23 04:38:53 2022] POST /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:38:53.874344 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:53.889830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:53.891391 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:53.892732 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:53.945533 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] Creating event network-changed:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:38:53.972924 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-476e0340-d00c-4055-8eba-91f89684863a req-d522b1ce-63ad-4751-9639-3ac5e814074c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191502 Aug 23 04:38:53.974153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 503/973] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:38:54.000585 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:54.009971 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-bbdce461-b792-42fa-8ccd-be7db4b537ff tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1520 microversion: 2.1 time: 0.256037 Aug 23 04:38:54.023883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 471/974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:53 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:54.723737 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "name": "network-vif-unplugged", "status": "completed", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:54.747327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:54.748168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:54.748780 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:54.761688 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] Creating event network-vif-unplugged:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:38:54.767408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-a6c470a4-649a-464e-b8eb-7420fde4a5b3 req-28787acf-98cc-4402-ba15-058105903693 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143263 Aug 23 04:38:54.768646 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 504/975] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:38:55.031169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:55.031937 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:55.038870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.039366 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.039943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.040653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.041098 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.041551 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.244537 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:55.253740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b87b55b8-a697-4d22-b9c6-5b8698aaf37d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.226525 Aug 23 04:38:55.254385 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 472/976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:55 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:55.342027 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:55.342907 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:55.350076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.350631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.351133 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.352188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.352848 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.353471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.407165 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:38:55.417276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.417752 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.418200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.429454 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] Creating event network-changed:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:38:55.436006 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-5120f099-129d-4dea-91a0-25fd8b3ec8b6 req-ae246f54-50bb-4259-9579-92b7e0d363a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095776 Aug 23 04:38:55.436607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 473/977] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:38:55.440251 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lazy-loading 'services' on Instance uuid a193c81c-8f87-4701-96e8-e37c0dd65b88 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:38:55.516306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6499f2dc-dd49-41df-92a7-0d59b3aea496 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments/f135a786-b261-4939-8b7a-ca47d5f8a431" status: 202 len: 0 microversion: 2.1 time: 0.178821 Aug 23 04:38:55.517094 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 505/978] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:38:55 2022] DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments/f135a786-b261-4939-8b7a-ca47d5f8a431 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:38:55.526145 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:55.528650 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:55.544490 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.544984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.545415 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.546319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:55.546930 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:55.547552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:55.592182 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-af5d10c6-d5ad-451c-8828-e226f6336c07 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070543 Aug 23 04:38:55.592969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 474/979] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:38:55 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:38:56.276318 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:56.277021 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:56.283617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.284169 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.284900 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.286074 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.286889 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.287683 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.432146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:56.440052 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a721616c-1c0f-4a71-9786-e10e736a98d4 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.168811 Aug 23 04:38:56.440631 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 506/980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:56 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:56.608691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:56.610995 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:56.618471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.619000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.619527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.620854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.621356 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.621821 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.653379 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-f6a03629-7174-4f55-b0b9-46ce3afa2e60 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050351 Aug 23 04:38:56.653924 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 475/981] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Aug 23 04:38:56 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 04:38:56.667535 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:56.668134 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:56.674674 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.675141 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.675557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.676268 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:56.676706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:56.677115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:56.756115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] HTTP exception thrown: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 is not attached to volume f135a786-b261-4939-8b7a-ca47d5f8a431 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Request method failure captured: Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments/f135a786-b261-4939-8b7a-ca47d5f8a431 HTTP/1.1 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFlzoTKH_6NNUeZES-bgI0dkcM-CIcJVEXV2Yqhxt0umFtWn4iMajQizyMtiyeCSneJPkqje7ZCxVjm1orGbO4mw5SaWPvMyLH8peZAU61f3v0bUprx0gTpTnxT9uIpCFBXyhlM4OH0vauJCTJjDhNhw0qIFC4Ey8tvm54jEL5hFDo8 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 0111954f3e6e430387495701fa502227 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:38:56.758514 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0111954f3e6e430387495701fa502227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0111954f3e6e430387495701fa502227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0111954f3e6e430387495701fa502227", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0111954f3e6e430387495701fa502227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 0111954f3e6e430387495701fa502227 Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-TestMinimumBasicScenario-1171159790-project Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 7c1f40a97d2e42668e18961b8fd8a065 Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-TestMinimumBasicScenario-1171159790-project Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:38:56.760341 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 is not attached to volume f135a786-b261-4939-8b7a-ca47d5f8a431 Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'server_id': 'a193c81c-8f87-4701-96e8-e37c0dd65b88', 'id': 'f135a786-b261-4939-8b7a-ca47d5f8a431'} Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f135a786-b261-4939-8b7a-ca47d5f8a431. Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:38:56.761165 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 is not attached to volume f135a786-b261-4939-8b7a-ca47d5f8a431 Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 is not attached to volume f135a786-b261-4939-8b7a-ca47d5f8a431 Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:38:56.762636 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Returning 404 to user: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 is not attached to volume f135a786-b261-4939-8b7a-ca47d5f8a431 {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:38:56.763786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f5e94a8a-2fe4-48cb-988c-f79af610eec0 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments/f135a786-b261-4939-8b7a-ca47d5f8a431" status: 404 len: 154 microversion: 2.1 time: 0.098720 Aug 23 04:38:56.763786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 507/982] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Aug 23 04:38:56 2022] DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88/os-volume_attachments/f135a786-b261-4939-8b7a-ca47d5f8a431 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 04:38:57.464814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:57.465894 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:57.476215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:57.477010 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:57.477714 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:57.478977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:57.479773 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:57.480174 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:57.626355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:57.634321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-750903f6-1afd-4b71-a351-6a60509497e8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.176110 Aug 23 04:38:57.634883 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 476/983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:57 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:57.923564 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:57.924106 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:57.930829 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:57.931292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:57.931732 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:57.933016 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:57.933464 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:57.933881 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:58.117781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:38:58.203406 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9fe6b430-7c6f-4d54-8163-c00b8f0eb10a tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 204 len: 0 microversion: 2.1 time: 0.283320 Aug 23 04:38:58.204112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 508/984] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:38:57 2022] DELETE /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:38:58.212771 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:58.213607 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:58.219750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:58.220295 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:58.220723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:58.221402 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:58.221871 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:58.222286 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:58.371564 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:58.381458 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-9db9ef2c-a6fb-4c96-935e-463a715b1762 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1555 microversion: 2.1 time: 0.172662 Aug 23 04:38:58.382014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 477/985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:58 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:58.661466 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:58.662144 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:58.668935 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:58.669424 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:58.669837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:58.670518 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:58.670956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:58.671365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:58.807420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:58.811179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:58.816409 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ac7988c5-f73f-43ac-aaf2-00f235341720 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.159189 Aug 23 04:38:58.816961 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 509/986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:58 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:59.407737 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:59.408772 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:59.419783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:59.420655 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:59.421363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:59.422495 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:59.423243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:59.423980 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:59.430719 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:38:59.563226 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:38:59.571159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6e7eeabb-640d-425a-9cef-c7195cca8f24 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1555 microversion: 2.1 time: 0.170387 Aug 23 04:38:59.571907 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 478/987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:59 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:38:59.837711 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:38:59.838627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:38:59.845712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:59.846196 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:59.846614 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:38:59.847326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:38:59.847776 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:38:59.848235 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:00.066300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:39:00.074411 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-91c9c2ee-9c9d-4bdf-b24b-ff283e5d85c9 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.240873 Aug 23 04:39:00.074978 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 510/988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:38:59 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:39:00.388627 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a193c81c-8f87-4701-96e8-e37c0dd65b88", "name": "network-vif-deleted", "tag": "2213fa9a-5e72-4595-84d3-73ed7c74d8ca"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:39:00.399560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:00.400063 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:00.400525 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:00.412858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] Creating event network-vif-deleted:2213fa9a-5e72-4595-84d3-73ed7c74d8ca for instance a193c81c-8f87-4701-96e8-e37c0dd65b88 on hv-cinder-85407 Aug 23 04:39:00.418362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-8e468bb1-bc17-4941-92ae-37d45ca036f5 req-59f5a657-e37d-4de4-aa7b-a5ec8191d83b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 Aug 23 04:39:00.418956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 479/989] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:39:00.596883 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:00.598419 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:39:00.607618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:00.608138 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:00.608566 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:00.609264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:00.609719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:00.610136 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:00.642840 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:00.643223 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:00.643647 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:00.644115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lazy-loading 'fault' on Instance uuid a193c81c-8f87-4701-96e8-e37c0dd65b88 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:39:00.686343 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1f40a97d2e42668e18961b8fd8a065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0111954f3e6e430387495701fa502227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:39:00.694895 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e3b47f81-a700-4441-9f77-1de34df3a6a1 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 200 len: 1348 microversion: 2.1 time: 0.104462 Aug 23 04:39:00.695474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 511/990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:39:00 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:39:01.101061 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:01.102199 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:39:01.109371 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:01.109854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:01.110277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:01.110956 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:01.111400 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:01.111811 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:01.250378 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:39:01.261826 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-d0678fe1-4d98-4795-8e5e-096bf069ef09 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.168330 Aug 23 04:39:01.262609 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 480/991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:39:01 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:39:01.720312 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:01.721217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] [instance: a193c81c-8f87-4701-96e8-e37c0dd65b88] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:39:01.733420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:01.734217 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:01.734943 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:01.736135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:01.736924 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:01.737619 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:01.753768 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] HTTP exception thrown: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Request method failure captured: Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 HTTP/1.1 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFlzoTKH_6NNUeZES-bgI0dkcM-CIcJVEXV2Yqhxt0umFtWn4iMajQizyMtiyeCSneJPkqje7ZCxVjm1orGbO4mw5SaWPvMyLH8peZAU61f3v0bUprx0gTpTnxT9uIpCFBXyhlM4OH0vauJCTJjDhNhw0qIFC4Ey8tvm54jEL5hFDo8 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 0111954f3e6e430387495701fa502227 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:39:01.755398 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0111954f3e6e430387495701fa502227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0111954f3e6e430387495701fa502227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0111954f3e6e430387495701fa502227", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0111954f3e6e430387495701fa502227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 0111954f3e6e430387495701fa502227 Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1171159790 Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-TestMinimumBasicScenario-1171159790-project Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 7c1f40a97d2e42668e18961b8fd8a065 Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-TestMinimumBasicScenario-1171159790-project Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. Aug 23 04:39:01.756954 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'a193c81c-8f87-4701-96e8-e37c0dd65b88'} Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:39:01.757786 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. Aug 23 04:39:01.759361 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:39:01.761158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Returning 404 to user: Instance a193c81c-8f87-4701-96e8-e37c0dd65b88 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:39:01.761158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6effca0e-d208-4ee3-bf58-7de5a68821e2 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88" status: 404 len: 111 microversion: 2.1 time: 0.043977 Aug 23 04:39:01.761158 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 512/992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:39:01 2022] GET /compute/v2.1/servers/a193c81c-8f87-4701-96e8-e37c0dd65b88 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:39:01.765852 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c5031cc2-019c-45a5-b3c3-28e0adaa25d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] Calling method '.version_select at 0x7f9c16dd4a60>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:01.787816 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c5031cc2-019c-45a5-b3c3-28e0adaa25d6 tempest-TestMinimumBasicScenario-1171159790 tempest-TestMinimumBasicScenario-1171159790-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287717041" status: 202 len: 0 microversion: 2.1 time: 0.025837 Aug 23 04:39:01.788411 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 481/993] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Aug 23 04:39:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287717041 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:39:02.282958 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:02.283553 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:39:02.289775 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:02.290245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:02.290665 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:02.291429 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:02.292182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:02.292693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:02.430548 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:39:02.438974 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a61ff1d6-a206-4b69-9669-692cf49a0d73 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1576 microversion: 2.1 time: 0.160007 Aug 23 04:39:02.439541 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 513/994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:39:02 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:39:03.460762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:39:03.461616 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:39:03.469342 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:03.470169 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:03.470724 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:03.471662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:03.472612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:03.472612 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:03.614638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:39:03.623015 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b3dd2396-e2c5-42a5-9602-affdd16d9d98 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1563 microversion: 2.1 time: 0.166749 Aug 23 04:39:03.636575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 482/995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:39:03 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:39:04.713036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "name": "network-vif-plugged", "status": "completed", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:39:04.726147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:39:04.726890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:39:04.727783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:39:04.743062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] Creating event network-vif-plugged:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:39:04.751599 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-1130fc9d-459d-4651-b8fa-54b40d2464c3 req-fc352fd9-b9e8-41fb-8d96-653bca1f4976 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042798 Aug 23 04:39:04.752394 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 514/996] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:39:11.357302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:39:11.358406 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:39:16.697101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:39:16.697101 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:40:17.606996 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:17.607876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=18 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:17.610621 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:17.612129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=24 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:17.612316 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:17.612815 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:17.617791 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:40:17.621034 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:17.621516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:17.621936 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:17.622624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:17.623065 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:17.623479 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:17.628818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:17.629293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:17.629756 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:17.642153 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] Creating event network-changed:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:40:17.647542 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-4d83a53c-54b1-4167-887e-b4098a11d5d5 req-07400ded-4aff-4790-893b-f22c77cc6478 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040197 Aug 23 04:40:17.648184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 515/997] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:40:17.652638 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:40:17.734775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1a8af4d7-f1eb-4781-9d54-73c931f6c68c tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 204 len: 0 microversion: 2.1 time: 0.129654 Aug 23 04:40:17.735993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 483/998] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:40:17 2022] DELETE /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:40:17.744720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:17.745839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:17.754454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:17.754987 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:17.755419 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:17.756203 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:17.756651 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:17.757597 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:17.910533 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:17.918857 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-6afd555b-e8bd-4709-b248-fd4c3c613dd8 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.178643 Aug 23 04:40:17.919457 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 516/999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:17 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:18.941248 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:18.941938 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:18.949045 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:18.949517 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:18.949943 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:18.950626 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:18.951068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:18.951485 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:19.110179 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:19.119068 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-905c679e-a6e8-4d88-98ba-aad2e06c8f31 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1569 microversion: 2.1 time: 0.182306 Aug 23 04:40:19.119665 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 484/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:18 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:19.696907 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e91829-1333-46b6-8b6f-b3b57faa0098", "name": "network-vif-deleted", "tag": "d00893ca-781d-4af3-a48a-067a77921424"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:40:19.708015 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:19.708496 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:19.708971 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:19.721462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] Creating event network-vif-deleted:d00893ca-781d-4af3-a48a-067a77921424 for instance c4e91829-1333-46b6-8b6f-b3b57faa0098 on hv-cinder-85407 Aug 23 04:40:19.726799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-716fe004-0297-457a-b018-4102e62e814c req-edd95ce9-8fbd-4ed4-a809-3f32ee977e69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Aug 23 04:40:19.727380 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 517/1001] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:40:20.152755 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:20.153416 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:20.161268 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:20.161754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:20.162208 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:20.162902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:20.163349 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:20.163762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:20.202438 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:20.202832 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:20.203256 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:20.203691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.objects.instance [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lazy-loading 'fault' on Instance uuid c4e91829-1333-46b6-8b6f-b3b57faa0098 {{(pid=121224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:40:20.252249 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7ac4048d0646f78c0d813fa0112a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7aa0063804717a00a59ea3e188779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:20.261633 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b3583f04-fa1d-46f9-a027-21ba8e2b233d tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 200 len: 1225 microversion: 2.1 time: 0.114721 Aug 23 04:40:20.262195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 485/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:20 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:21.288691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:21.290185 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] [instance: c4e91829-1333-46b6-8b6f-b3b57faa0098] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:21.300851 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:21.301332 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:21.301766 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:21.302465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:21.302918 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:21.303335 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:21.316934 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] HTTP exception thrown: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Request method failure captured: Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 HTTP/1.1 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFkykQAmT-9gXio4YFPTNdcouXDfyFGRj_3SRV3WmtZEdkeXyXjnQHdGP3Ai4RibHzmzAPH_eODDN3zh0hS47LLHXCn-ZMwrMT5KRlTVbpmEdmMh4vgM5_hgRVzEoduL38FMBjlrOGErEaFVwWFXFQzgD3pZ_nzPmBmUKWZZfdTlvhM Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 0fa7aa0063804717a00a59ea3e188779 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-TestShelveInstance-378856999 Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:40:21.318616 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa7aa0063804717a00a59ea3e188779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa7aa0063804717a00a59ea3e188779"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa7aa0063804717a00a59ea3e188779", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa7aa0063804717a00a59ea3e188779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-TestShelveInstance-378856999 Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 0fa7aa0063804717a00a59ea3e188779 Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-TestShelveInstance-378856999 Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-TestShelveInstance-378856999-project Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 6a7ac4048d0646f78c0d813fa0112a83 Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-TestShelveInstance-378856999-project Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. Aug 23 04:40:21.320270 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'c4e91829-1333-46b6-8b6f-b3b57faa0098'} Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:40:21.321183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. Aug 23 04:40:21.322729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:40:21.324115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Returning 404 to user: Instance c4e91829-1333-46b6-8b6f-b3b57faa0098 could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:40:21.324115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-37479a7a-1e6d-4ae0-a235-732b348a9e10 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098" status: 404 len: 111 microversion: 2.1 time: 0.039366 Aug 23 04:40:21.324115 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 518/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:21 2022] GET /compute/v2.1/servers/c4e91829-1333-46b6-8b6f-b3b57faa0098 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:40:21.489292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-fdb70432-8dad-4461-9be8-dc99164467a7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] Calling method '.version_select at 0x7f9c16f301f0>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:21.527257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-fdb70432-8dad-4461-9be8-dc99164467a7 tempest-TestShelveInstance-378856999 tempest-TestShelveInstance-378856999-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1987449574" status: 202 len: 0 microversion: 2.1 time: 0.042309 Aug 23 04:40:21.527846 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 486/1004] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Aug 23 04:40:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1987449574 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:40:38.689796 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=8 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:38.691384 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=12 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:38.885552 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-39d1d0c8-887c-49ec-a0b0-66e5e1012a78 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Action: 'create', calling method: .version_select at 0x7f9c16d8a040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-759400215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqOoJ+eJt0GQab6Ie0nrAi3VeD9vVyv9a25SzXKI5rdRDGIz3PZbXnDkTELVzraEAQYm1x6TFCBG3+W5iCYk84vXUeVKDXnYukSoiKyNMQFWXz4R+SpQ7JP6AYfL27H1A=="}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:40:38.901869 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-39d1d0c8-887c-49ec-a0b0-66e5e1012a78 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:40:38.906685 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-39d1d0c8-887c-49ec-a0b0-66e5e1012a78 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for user 041280e59ffa4e518a599442fe9ded41 and project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'key_pairs'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:40:38.940110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-39d1d0c8-887c-49ec-a0b0-66e5e1012a78 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.255355 Aug 23 04:40:38.940837 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 519/1005] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Aug 23 04:40:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:40:54.628040 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:54.628962 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:54.633204 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1109756668", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-759400215", "security_groups": [{"name": "tempest-secgroup-smoke-108443016"}], "block_device_mapping_v2": [{"uuid": "f2503052-6fd4-4196-a27a-c810be2f15a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2eb75b95-a291-40f1-aaf4-e60ccd720d3f"}]}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:40:54.752981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] validate_networks() for [('2eb75b95-a291-40f1-aaf4-e60ccd720d3f', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:40:55.238723 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:40:55.239287 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:40:55.239969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:40:55.240527 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:40:55.241099 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:40:55.255784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:55.256452 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:55.257043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:55.258116 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:55.258753 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:55.259329 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:55.276754 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:40:55.281168 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for user 041280e59ffa4e518a599442fe9ded41 and project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:40:55.338915 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:40:55.341059 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2503052-6fd4-4196-a27a-c810be2f15a6',volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:40:55.479550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a2d25a7a-015b-4a91-aa8a-9892d6e3af27 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.852953 Aug 23 04:40:55.480210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 487/1006] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:40:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:40:55.488586 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=4 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:55.489401 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:40:55.493365 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-624656e7-833f-4d89-a1f9-094a95c79ba8 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:55.494666 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-624656e7-833f-4d89-a1f9-094a95c79ba8 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:55.555453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-624656e7-833f-4d89-a1f9-094a95c79ba8 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:55.563327 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-624656e7-833f-4d89-a1f9-094a95c79ba8 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1094 microversion: 2.1 time: 0.076157 Aug 23 04:40:55.563873 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 520/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:55 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:56.585296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:56.585919 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:56.593047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:56.593559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:56.593961 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:56.594645 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:56.595106 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:56.595524 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:56.661756 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:56.669898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-6dd8e4a7-1588-4a03-af90-72d720403a7f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1210 microversion: 2.1 time: 0.089311 Aug 23 04:40:56.670472 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 488/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:56 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:57.691606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:57.692251 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:57.699852 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:57.700359 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:57.700784 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:57.701474 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:57.701968 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:57.702380 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:57.799011 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57416f1-6a5d-4929-86a5-791ae15f40ec", "tag": "9fa21686-8ca9-458f-aaf4-d7b8ece1bc52"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:40:57.811087 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:57.811662 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:57.812392 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:57.824700 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] Creating event network-changed:9fa21686-8ca9-458f-aaf4-d7b8ece1bc52 for instance b57416f1-6a5d-4929-86a5-791ae15f40ec on hv-cinder-85407 Aug 23 04:40:57.830041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-9c4b30fc-1eeb-4036-8a4d-d6227298251c req-ec9761b2-5d8c-4289-b19a-f8bd0c2aefa5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Aug 23 04:40:57.831319 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 489/1009] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:40:57.866310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:57.875062 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3bd6876d-e77e-4fc8-8a1d-e61c9642dc2f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.187658 Aug 23 04:40:57.875866 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 521/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:57 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:40:58.897129 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:40:58.897955 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:40:58.904630 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:58.905929 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:58.906385 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:58.907107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:40:58.907571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:40:58.908036 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:40:59.053471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:40:59.065425 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c494dd48-dedf-4268-8139-a1c81a0f1a6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.172704 Aug 23 04:40:59.066163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 490/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:40:58 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:00.090842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:00.091539 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:00.100488 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:00.101090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:00.101649 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:00.102538 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:00.103120 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:00.103739 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:00.239065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:00.247113 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-94c73c0f-ede3-4ef9-b6b0-7b18ac39bc29 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.162037 Aug 23 04:41:00.247680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 522/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:00 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:01.272146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:01.273035 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:01.284195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:01.285019 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:01.285740 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:01.286880 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:01.287634 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:01.288387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:01.446518 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:01.456602 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-34b1a077-5b23-482a-ac0c-63184a7d142b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.191091 Aug 23 04:41:01.457190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 491/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:01 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:02.482148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:02.482764 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:02.489679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:02.490157 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:02.490592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:02.491287 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:02.491740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:02.492200 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:02.634657 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:02.642908 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ede35ef8-9958-45f2-9b5d-1b5cc1844477 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.166920 Aug 23 04:41:02.643448 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 523/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:02 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:03.665694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:03.666302 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:03.672994 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:03.673477 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:03.673906 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:03.674588 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:03.675031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:03.675444 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:03.814019 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:03.826019 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-45eccb2b-5ba7-4f89-8b69-8e5d0d4972f1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.164824 Aug 23 04:41:03.826875 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 492/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:03 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:04.861218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:04.861836 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:04.869846 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:04.870407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:04.870910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:04.871746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:04.872314 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:04.872861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:05.017051 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:05.024948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-98647ef1-cb5f-4150-b0da-328fb432d026 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.169523 Aug 23 04:41:05.025509 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 524/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:04 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:06.049598 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:06.050277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:06.053945 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:41:06.054680 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:41:06.063081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:06.064292 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:06.064858 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:06.065934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:06.066559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:06.067272 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:06.208344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:06.221558 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b0510706-910d-41a8-979b-be482237112f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.177569 Aug 23 04:41:06.222366 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 493/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:06 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:07.247112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:07.247715 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:07.249945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:41:07.256874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:07.257358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:07.257790 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:07.258487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:07.258940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:07.259358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:07.410746 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:07.418692 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7b539e9a-af41-4ca9-b549-93c58f7e1118 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.175625 Aug 23 04:41:07.419232 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 525/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:07 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:08.442978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:08.443949 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:08.455100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:08.455898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:08.456447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:08.457146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:08.457611 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:08.458033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:08.599107 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:08.607261 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ec866a9c-1a69-4d3e-8e2a-0bf31e2dd77b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.170936 Aug 23 04:41:08.607825 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 494/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:08 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:09.230551 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57416f1-6a5d-4929-86a5-791ae15f40ec", "name": "network-vif-plugged", "status": "completed", "tag": "9fa21686-8ca9-458f-aaf4-d7b8ece1bc52"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:41:09.242983 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:09.243678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:09.244150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:09.255592 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] Creating event network-vif-plugged:9fa21686-8ca9-458f-aaf4-d7b8ece1bc52 for instance b57416f1-6a5d-4929-86a5-791ae15f40ec on hv-cinder-85407 Aug 23 04:41:09.260841 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-7cedda5f-7635-4450-8c68-63f28a8d1b7c req-185030b3-6c7b-4566-8931-003849ace351 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034168 Aug 23 04:41:09.261513 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 526/1020] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:41:09.634507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:09.635501 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:09.648146 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:09.648944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:09.649704 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:09.650836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:09.651596 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:09.652343 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:09.804410 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:09.816885 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-3e47d4be-6b04-405d-8bc8-495c00595c71 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1265 microversion: 2.1 time: 0.191043 Aug 23 04:41:09.817561 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 495/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:09 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:10.840600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:10.841390 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:10.850568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:10.851195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:10.851798 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:10.852765 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:10.853364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:10.853951 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:11.006306 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:11.014186 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f7c69f87-7089-4608-b448-5c186a744367 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1453 microversion: 2.1 time: 0.180384 Aug 23 04:41:11.014750 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 527/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:10 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:11.034618 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:41:11.035276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:41:11.042159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:11.042642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:11.043075 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:11.043788 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:11.044297 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:11.044694 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:11.187762 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:41:11.197163 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1231a381-dc64-4271-8f7d-89984e21aafc tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1453 microversion: 2.1 time: 0.166845 Aug 23 04:41:11.197731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 496/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:41:11 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:41:12.873658 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57416f1-6a5d-4929-86a5-791ae15f40ec", "tag": "9fa21686-8ca9-458f-aaf4-d7b8ece1bc52"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:41:12.883725 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:41:12.884225 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:41:12.884649 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:41:12.895558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] Creating event network-changed:9fa21686-8ca9-458f-aaf4-d7b8ece1bc52 for instance b57416f1-6a5d-4929-86a5-791ae15f40ec on hv-cinder-85407 Aug 23 04:41:12.901445 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-3d7d8d48-715c-4a14-81d4-22418856a4e7 req-368d3f7c-1de9-492f-b505-b2b7cc7012bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031408 Aug 23 04:41:12.902107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 528/1024] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:42:25.692936 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:42:25.693582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:43:08.483959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:08.484931 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=52 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:08.489507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:08.490081 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:08.497944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:08.498430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:08.498863 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:08.499546 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:08.500024 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:08.500444 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:08.526195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Going to try to terminate instance {{(pid=121224) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:43:08.621471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b42180ac-b0dc-44f3-a2ef-32ae8131da97 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 204 len: 0 microversion: 2.1 time: 0.139160 Aug 23 04:43:08.622110 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 497/1025] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:43:08 2022] DELETE /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:43:08.631902 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b6330f0-7b12-4a66-bf5b-f5283a93f86f] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 04:43:08.632526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=20 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:08.633362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=40 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:08.638656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:08.639342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:08.646184 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:08.646652 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:08.647075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:08.647748 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:08.648222 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:08.648788 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:08.844804 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:08.854161 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2b85f834-4457-48c9-a39a-c0e26c9c7d56 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1578 microversion: 2.1 time: 0.226451 Aug 23 04:43:08.854701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 529/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:08 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:09.875877 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:09.876582 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:09.883121 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:09.883593 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:09.884215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:09.884993 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:09.885439 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:09.885852 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:10.080419 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:10.089014 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e11d38cd-3f6b-40c8-8470-8061082c91fe tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1578 microversion: 2.1 time: 0.217507 Aug 23 04:43:10.089595 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 498/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:09 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:10.994678 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57416f1-6a5d-4929-86a5-791ae15f40ec", "name": "network-vif-deleted", "tag": "9fa21686-8ca9-458f-aaf4-d7b8ece1bc52"}]} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:43:11.012628 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b6330f0-7b12-4a66-bf5b-f5283a93f86f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41576. Aug 23 04:43:11.015415 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:11.015879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:11.016331 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:11.033129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.compute.server_external_events [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] Creating event network-vif-deleted:9fa21686-8ca9-458f-aaf4-d7b8ece1bc52 for instance b57416f1-6a5d-4929-86a5-791ae15f40ec on hv-cinder-85407 Aug 23 04:43:11.038502 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [req-98eaeeaa-8c29-40c8-945e-96e288f3f592 req-0a37b547-ee32-4a90-aff5-eb5201991f90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047631 Aug 23 04:43:11.039095 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 530/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:43:11.110744 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:11.111363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:11.118691 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:11.119223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:11.119648 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:11.120860 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:11.121313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:11.121729 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:11.189263 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:11.198314 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-c9bb4bfe-3e05-46cd-b66f-19c43bc59d88 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 200 len: 1225 microversion: 2.1 time: 0.091436 Aug 23 04:43:11.199498 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 499/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:11 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:43:12.224163 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:12.225212 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:12.233250 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:12.233722 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:12.234146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:12.234825 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:12.235265 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:12.235679 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:12.249789 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] HTTP exception thrown: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Request method failure captured: Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec HTTP/1.1 Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFpBsDV_t3q5LYvtkIyp96DmrfZioPpwlVWZ3Rcv0fYs0mJvJsImZU5iR0gSlvyoaFA69ZnCt1yelHxGwjHKvc9YHJWJYI8x12RLYWZbCVYSy01Rv7BrxL07LJbkTMjTKATPbhY083PiRbiAJUpYSAcsC_D7v4eUyU9tG4FqJtniCAQ Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:43:12.251407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65e721c90c8d41088ec9f9d92dd5858d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-TestVolumeBootPattern-312866803 Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 041280e59ffa4e518a599442fe9ded41 Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:43:12.253179 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'b57416f1-6a5d-4929-86a5-791ae15f40ec'} Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:43:12.254310 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:43:12.255860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:43:12.257285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Returning 404 to user: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:43:12.257285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-99206747-3ecd-436b-975e-fe80e0898764 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 404 len: 111 microversion: 2.1 time: 0.036203 Aug 23 04:43:12.257285 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 531/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:12 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:43:12.306159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-96112760", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-759400215", "security_groups": [{"name": "tempest-secgroup-smoke-108443016"}], "block_device_mapping_v2": [{"uuid": "f2503052-6fd4-4196-a27a-c810be2f15a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2eb75b95-a291-40f1-aaf4-e60ccd720d3f"}]}} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:43:12.426790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.network.neutron [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] validate_networks() for [('2eb75b95-a291-40f1-aaf4-e60ccd720d3f', None, None, None, None, None)] {{(pid=121224) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:43:12.811750 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:43:12.812198 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image limits 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:43:12.812667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:43:12.813043 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image pref 0:0:0 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:43:12.813443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.virt.hardware [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:43:12.825321 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:12.825804 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:12.826237 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:12.826958 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:12.827411 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:12.827814 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:12.844977 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:43:12.849355 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.quota [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for user 041280e59ffa4e518a599442fe9ded41 and project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121224) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:43:12.907344 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Going to run 1 instances... {{(pid=121224) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:43:12.909522 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2503052-6fd4-4196-a27a-c810be2f15a6',volume_size=None,volume_type=None)] {{(pid=121224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:43:13.064331 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-63b6bc22-c1a9-44fd-aeed-7226f691a2fb tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.762141 Aug 23 04:43:13.064944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 500/1031] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:43:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:43:13.076320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-19a713ef-18e7-4325-9211-2cf9d76cf538 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:13.076948 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-19a713ef-18e7-4325-9211-2cf9d76cf538 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:13.132320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-19a713ef-18e7-4325-9211-2cf9d76cf538 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:13.139584 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-19a713ef-18e7-4325-9211-2cf9d76cf538 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1092 microversion: 2.1 time: 0.067350 Aug 23 04:43:13.140187 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 532/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:13 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:14.159426 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:14.160745 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:14.168294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:14.168868 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:14.169542 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:14.170443 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:14.171150 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:14.171813 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:14.236253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:14.244372 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-cc56c5dc-7ac2-4e0e-aca2-904ab975380f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1208 microversion: 2.1 time: 0.088760 Aug 23 04:43:14.244898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 501/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:14 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:15.265418 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:15.266146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:15.273624 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:15.274182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:15.274667 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:15.275370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:15.275818 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:15.276273 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:15.387434 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d986b25-967a-4826-acec-41d417b05879", "tag": "cd10355d-64db-4077-8d08-9436826aea73"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:43:15.397983 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:15.398882 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:15.399569 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:15.414545 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] Creating event network-changed:cd10355d-64db-4077-8d08-9436826aea73 for instance 6d986b25-967a-4826-acec-41d417b05879 on hv-cinder-85407 Aug 23 04:43:15.418860 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:15.420998 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-7985c28d-8c44-4ad8-aa48-6d1957ed9c9a req-80837c9d-b5a0-4164-ac66-931d39e1915b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037220 Aug 23 04:43:15.421639 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 502/1034] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:43:15.427510 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-73b289f2-0262-4376-b607-ab22ea5922e7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.166043 Aug 23 04:43:15.428583 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 533/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:15 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:16.450571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:16.451277 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:16.457775 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:16.458294 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:16.458728 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:16.459471 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:16.459948 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:16.460368 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:16.600966 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:16.612957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-648ac3fc-0dae-4591-9db5-598cedc91c32 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.167431 Aug 23 04:43:16.613594 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 503/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:16 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:17.640293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:17.641366 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:17.652358 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:17.653145 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:17.653854 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:17.654994 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:17.655719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:17.656453 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:17.796882 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:17.806617 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-b83e6d0c-54fb-4c4d-9672-65cec331afff tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.173077 Aug 23 04:43:17.807182 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 534/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:17 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:18.831507 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:18.832399 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:18.841069 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:18.841553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:18.841984 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:18.842672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:18.843119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:18.843538 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:18.986009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:18.994470 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-acd3eae0-1842-4cf4-8a6a-b6dc9bcece2d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.169744 Aug 23 04:43:18.995053 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 504/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:18 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:20.026743 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:20.028506 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:20.042350 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:20.043171 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:20.043887 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:20.045491 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:20.046126 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:20.046720 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:20.204783 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:20.213425 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-4eca1e8c-ad99-4b6d-8bf7-ee6c41097ad1 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.198691 Aug 23 04:43:20.214001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 535/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:20 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:21.243282 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:21.244112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:21.254215 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:21.255004 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:21.255710 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:21.256862 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:21.257589 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:21.258284 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:21.403532 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:21.415414 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-723906a3-358a-4662-b533-692cbd505f2b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.177537 Aug 23 04:43:21.416195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 505/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:21 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:22.437129 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:22.437801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:22.444601 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:22.445084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:22.445547 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:22.446277 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:22.446979 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:22.447423 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:22.596982 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:22.606536 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-348cb170-061b-4692-b304-f5963c64734e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.173298 Aug 23 04:43:22.607110 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 536/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:22 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:23.629782 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:23.630383 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:23.635189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=2 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:23.635896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=6 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:23.640624 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:23.641200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:23.641629 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:23.643509 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:23.644083 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:23.644566 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:23.786243 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:23.794399 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-52307f69-de0b-4fbb-a2eb-62b1786c5d33 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.168676 Aug 23 04:43:23.795219 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 506/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:23 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:24.817442 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:24.818061 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:24.820050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:43:24.826506 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:24.826981 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:24.827407 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:24.828122 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:24.828568 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:24.828970 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:24.966481 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:24.975107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-387e276d-3641-4a25-999d-9f222cf49dc9 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.161600 Aug 23 04:43:24.975675 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 537/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:24 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:25.908910 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d986b25-967a-4826-acec-41d417b05879", "name": "network-vif-plugged", "status": "completed", "tag": "cd10355d-64db-4077-8d08-9436826aea73"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:43:25.919050 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:25.919516 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:25.919933 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:25.932896 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] Creating event network-vif-plugged:cd10355d-64db-4077-8d08-9436826aea73 for instance 6d986b25-967a-4826-acec-41d417b05879 on hv-cinder-85407 Aug 23 04:43:25.937947 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-f5c08afe-50b3-4d00-93bb-d9e1c1df0605 req-e38837fd-f295-4a31-9fc0-fee80a0b4769 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032900 Aug 23 04:43:25.938547 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 507/1044] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:43:25.996945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:25.997546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:26.003905 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:26.004408 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:26.004834 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:26.005516 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:26.005957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:26.006362 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:26.141399 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:26.149298 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f87b10fe-9412-40c1-bbe3-6929bd8298ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1263 microversion: 2.1 time: 0.156744 Aug 23 04:43:26.149887 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 538/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:25 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:27.171343 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:27.172090 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:27.178447 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:27.178734 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:27.179160 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:27.179844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:27.180440 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:27.180854 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:27.319559 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:27.328736 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-a63c05cc-aa77-4081-9c0a-cf893505f92a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1451 microversion: 2.1 time: 0.162144 Aug 23 04:43:27.329290 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 508/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:27 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:43:27.357454 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:43:27.358146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:43:27.365029 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:27.365509 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:27.365925 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:27.366610 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:27.367060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:27.367479 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:27.501125 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:43:27.509719 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-c5748afb-451d-4d5d-beb0-89189d5dd7a7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1451 microversion: 2.1 time: 0.156224 Aug 23 04:43:27.510281 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 539/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:43:27 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:43:29.388307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d986b25-967a-4826-acec-41d417b05879", "tag": "cd10355d-64db-4077-8d08-9436826aea73"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:43:29.398103 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:43:29.398578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:43:29.399161 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:43:29.411693 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] Creating event network-changed:cd10355d-64db-4077-8d08-9436826aea73 for instance 6d986b25-967a-4826-acec-41d417b05879 on hv-cinder-85407 Aug 23 04:43:29.416973 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-f15aea39-c64f-4dcf-92a6-90bc45e82257 req-e714f0f0-18f8-4de0-826b-1017919115cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032344 Aug 23 04:43:29.417578 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 509/1048] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 04:44:16.697712 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:44:16.698235 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:44:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:45:06.485693 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=24 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:06.486452 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=52 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:06.491302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-337223104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-759400215", "security_groups": [{"name": "tempest-secgroup-smoke-108443016"}], "block_device_mapping_v2": [{"uuid": "5e085f0a-1322-43b0-8b7d-98bcf026a712", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2eb75b95-a291-40f1-aaf4-e60ccd720d3f"}]}} {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:45:06.631036 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.network.neutron [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] validate_networks() for [('2eb75b95-a291-40f1-aaf4-e60ccd720d3f', None, None, None, None, None)] {{(pid=121223) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 04:45:07.074440 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 04:45:07.074847 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image limits 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 04:45:07.075307 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Flavor pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 04:45:07.075701 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Image pref 0:0:0 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 04:45:07.076132 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.virt.hardware [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121223) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 04:45:07.089435 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:07.090231 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:07.090957 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:07.091874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:07.092345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:07.092833 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:07.110898 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 04:45:07.115060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.quota [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Getting quotas for user 041280e59ffa4e518a599442fe9ded41 and project 65e721c90c8d41088ec9f9d92dd5858d. Resources: {'ram', 'cores', 'instances'} {{(pid=121223) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 04:45:07.178364 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Going to run 1 instances... {{(pid=121223) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 04:45:07.180508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e085f0a-1322-43b0-8b7d-98bcf026a712',volume_size=None,volume_type=None)] {{(pid=121223) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 04:45:07.329366 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a7df4de0-4963-4a45-b915-add8b309fca3 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.845331 Aug 23 04:45:07.330083 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 540/1049] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Aug 23 04:45:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 04:45:07.339637 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:07.340597 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:07.344967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-52a5072f-9da7-4edd-ba16-8a8f6245a978 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:07.345656 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-52a5072f-9da7-4edd-ba16-8a8f6245a978 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:07.405122 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-52a5072f-9da7-4edd-ba16-8a8f6245a978 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:07.411806 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-52a5072f-9da7-4edd-ba16-8a8f6245a978 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1093 microversion: 2.1 time: 0.074471 Aug 23 04:45:07.412398 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 510/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:07 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:08.432199 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e150d210-23b0-41be-9743-b17d9263f4d4 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:08.432803 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e150d210-23b0-41be-9743-b17d9263f4d4 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:08.487540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e150d210-23b0-41be-9743-b17d9263f4d4 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:08.495642 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e150d210-23b0-41be-9743-b17d9263f4d4 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1093 microversion: 2.1 time: 0.067358 Aug 23 04:45:08.496346 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 541/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:08 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:09.516898 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2a1997e1-b6f2-44d1-be9c-2714761bbf61 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:09.517614 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2a1997e1-b6f2-44d1-be9c-2714761bbf61 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:09.577115 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2a1997e1-b6f2-44d1-be9c-2714761bbf61 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:09.584309 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2a1997e1-b6f2-44d1-be9c-2714761bbf61 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1093 microversion: 2.1 time: 0.071481 Aug 23 04:45:09.584842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 511/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:09 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:10.610282 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-d7fd876e-d585-407d-ae4d-0428246a15e0 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:10.611150 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-d7fd876e-d585-407d-ae4d-0428246a15e0 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:10.944221 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-d7fd876e-d585-407d-ae4d-0428246a15e0 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:10.954001 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-d7fd876e-d585-407d-ae4d-0428246a15e0 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1093 microversion: 2.1 time: 0.351412 Aug 23 04:45:10.954573 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 542/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:10 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1093 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:11.974878 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:11.975501 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:11.982978 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:11.983576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:11.984047 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:11.984865 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:11.985363 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:11.985783 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:12.048673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:12.056698 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-1fbbd5c7-6fe3-452e-a51b-244d21730f85 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1135 microversion: 2.1 time: 0.086120 Aug 23 04:45:12.057318 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 512/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:11 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1135 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:13.079090 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:13.079470 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:13.085984 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:13.086696 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:13.087326 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:13.088348 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:13.088800 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:13.089215 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:13.230755 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:13.239953 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-8f0f3cbe-c5a7-4f92-b276-b77b16322773 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.166088 Aug 23 04:45:13.240537 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 543/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:13 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:13.846501 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1cfcf-9901-4c50-b164-3ea5d344df43", "tag": "cf6703cc-f8f4-4947-bc73-955074745713"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:45:13.856480 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:13.857259 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:13.857432 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:13.871667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] Creating event network-changed:cf6703cc-f8f4-4947-bc73-955074745713 for instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 on hv-cinder-85407 Aug 23 04:45:13.877307 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-ea69d1bc-bfa9-4298-aa79-c680df64979c req-0216f155-cbdc-4fb2-ab39-6a7514f1ba9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096944 Aug 23 04:45:13.877957 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 513/1056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:45:14.261955 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:14.262557 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:14.269615 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:14.270146 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:14.270575 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:14.271261 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:14.271706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:14.272170 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:14.419896 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:14.431526 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-3bb02bf7-db5f-45ff-85af-9f12bae7ab6b tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.173440 Aug 23 04:45:14.432076 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 544/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:14 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:15.454725 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:15.455377 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:15.462384 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:15.462870 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:15.463300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:15.464021 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:15.464474 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:15.464891 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:15.614844 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:15.623357 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-84d09698-f7d8-426a-bcaf-02adc5906c66 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.174150 Aug 23 04:45:15.623942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 514/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:15 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:16.647510 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:16.648475 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:16.657293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:16.657770 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:16.658195 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:16.658879 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:16.659317 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:16.659729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:16.793622 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:16.801726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-a58edd8b-7fd8-4fed-be86-3c16d2b36442 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.160875 Aug 23 04:45:16.802293 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 545/1059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:16 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:17.826718 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:17.827312 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:17.834157 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:17.834635 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:17.835058 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:17.835739 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:17.836211 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:17.836625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:17.981864 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:17.990031 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-e1d8d250-2678-4730-9bc1-2c0d051f1c2e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.169878 Aug 23 04:45:17.990576 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 515/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:17 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:19.022996 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:19.023971 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:19.026781 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=2 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:19.034003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:19.034490 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:19.034945 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:19.035618 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:19.036109 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:19.036547 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:19.174589 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:19.186691 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-2fc091ef-33ad-4273-b74f-2e7efe308f9f tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.170600 Aug 23 04:45:19.187243 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 546/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:19 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:20.210672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:20.211308 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:20.214784 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell0:SELECT=4 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:20.222323 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:20.223311 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:20.223902 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:20.224944 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:20.225550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:20.226091 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:20.365928 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:20.373833 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-b19bfe1a-eadf-47db-b04e-ec9a82cddc28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.168947 Aug 23 04:45:20.374404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 516/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:20 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:21.398773 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:21.399890 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:21.403387 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell0:SELECT=10 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:45:21.409849 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:21.410320 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:21.410744 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:21.411422 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:21.411861 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:21.412297 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:21.545249 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:21.553086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-9cf26df8-25d6-46e6-870a-cf73fdc33a7e tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.160924 Aug 23 04:45:21.553639 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 547/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:21 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:22.586681 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:22.587803 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:22.596671 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:22.597189 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:22.597687 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:22.598829 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:22.599280 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:22.599673 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:22.741058 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:22.749227 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-2d89335b-4b71-4b9b-b587-4b6e3f0a90da tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.169570 Aug 23 04:45:22.749819 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 517/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:22 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:23.774075 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:23.775003 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:23.785940 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:23.786740 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:23.787463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:23.788660 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:23.789462 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:23.790168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:23.925147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:23.933159 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-f1c15717-87a5-445d-b639-7b7adef2f285 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.165715 Aug 23 04:45:23.933706 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 548/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:23 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:24.505430 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1cfcf-9901-4c50-b164-3ea5d344df43", "name": "network-vif-plugged", "status": "completed", "tag": "cf6703cc-f8f4-4947-bc73-955074745713"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:45:24.515790 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:24.523300 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:24.523682 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:24.539064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] Creating event network-vif-plugged:cf6703cc-f8f4-4947-bc73-955074745713 for instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 on hv-cinder-85407 Aug 23 04:45:24.544188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-38f7c522-752c-4da3-8266-173f68170c7e req-a491ab7e-27a5-45b1-a25d-3286d3412c56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102752 Aug 23 04:45:24.544785 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 518/1066] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:45:24.958271 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:24.959183 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:24.969436 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:24.969910 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:24.970334 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:24.971018 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:24.971459 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:24.971869 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:25.116477 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:25.126368 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ce4336be-9283-4a0a-86c1-0c31f69278a2 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1264 microversion: 2.1 time: 0.174847 Aug 23 04:45:25.126901 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 549/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:24 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:26.147501 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:26.148257 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:26.155221 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:26.155842 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:26.156296 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:26.156976 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:26.157420 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:26.157831 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:26.292934 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:26.306670 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-81e312b6-6223-4086-9058-2850f57d9a28 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1451 microversion: 2.1 time: 0.163130 Aug 23 04:45:26.307666 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 519/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:26 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:26.329663 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:45:26.330302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:45:26.337413 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:26.337922 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:26.338345 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:26.339050 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:26.339494 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:26.339906 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:26.491378 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:45:26.499302 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-42e6c697-cf27-40e2-b6d2-f7f1de476324 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1451 microversion: 2.1 time: 0.173973 Aug 23 04:45:26.499875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 550/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:45:26 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:45:28.191033 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1cfcf-9901-4c50-b164-3ea5d344df43", "tag": "cf6703cc-f8f4-4947-bc73-955074745713"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:45:28.201758 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:45:28.202230 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:45:28.202653 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:45:28.216550 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] Creating event network-changed:cf6703cc-f8f4-4947-bc73-955074745713 for instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 on hv-cinder-85407 Aug 23 04:45:28.221730 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-4dc1fa93-5e86-4f13-a931-5d690e7d9a27 req-60a9d9e3-b87e-4fec-a475-3bb3f1d9fc2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Aug 23 04:45:28.222330 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 520/1070] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:45:45.703112 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:45:45.704253 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:45:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:45:51.374753 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:45:51.375721 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:45:56.713799 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:45:56.714651 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:45:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:46:14.431363 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:46:14.432342 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:46:59.735135 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:46:59.735990 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG dbcounter [-] [121223] Writing DB stats nova_cell1:SELECT=50 {{(pid=121223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:46:59.737975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_api:SELECT=26 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:46:59.739245 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG dbcounter [-] [121224] Writing DB stats nova_cell1:SELECT=42 {{(pid=121224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:46:59.741969 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:46:59.742967 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:46:59.743625 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1cfcf-9901-4c50-b164-3ea5d344df43", "tag": "cf6703cc-f8f4-4947-bc73-955074745713"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:46:59.752142 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:46:59.752749 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:46:59.753084 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:46:59.753830 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:46:59.754275 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:46:59.754531 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:46:59.754681 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:46:59.755063 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:46:59.755731 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:46:59.769541 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] Creating event network-changed:cf6703cc-f8f4-4947-bc73-955074745713 for instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 on hv-cinder-85407 Aug 23 04:46:59.774992 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-7943d34e-01f1-4675-ad25-99fa7718d961 req-10ea7e48-1400-4d0d-9c61-c813bb264998 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039047 Aug 23 04:46:59.775571 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 521/1071] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:46:59.783821 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:46:59.869464 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7d10f6f4-4451-4fd8-b79b-85bdaa72a68d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 204 len: 0 microversion: 2.1 time: 0.136151 Aug 23 04:46:59.870264 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 551/1072] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:46:59 2022] DELETE /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:46:59.879262 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:46:59.879981 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:46:59.886965 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:46:59.887642 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:46:59.888345 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:46:59.889235 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:46:59.889890 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:46:59.890504 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:00.031942 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:00.039967 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-ff61be48-f08b-4e14-8268-a5d7c40340c7 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1575 microversion: 2.1 time: 0.165081 Aug 23 04:47:00.041397 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 522/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:46:59 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:47:01.062352 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:01.062946 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:01.069519 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:01.069995 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:01.070416 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:01.071105 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:01.071540 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:01.071960 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:01.207850 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:01.216202 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-163886b6-c4dd-4a8d-b22f-18c76791f195 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1575 microversion: 2.1 time: 0.158394 Aug 23 04:47:01.216801 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 552/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:01 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:47:01.952009 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1cfcf-9901-4c50-b164-3ea5d344df43", "name": "network-vif-deleted", "tag": "cf6703cc-f8f4-4947-bc73-955074745713"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:47:01.961305 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:01.961770 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:01.962190 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:01.973848 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] Creating event network-vif-deleted:cf6703cc-f8f4-4947-bc73-955074745713 for instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 on hv-cinder-85407 Aug 23 04:47:01.978843 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-4f1a6e44-d4d7-4926-8483-9a5cbb0be984 req-3c476b81-fd0f-4365-85f5-ff2d47c36833 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129101 Aug 23 04:47:01.979483 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 523/1075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:47:02.238079 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:02.238672 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:02.245546 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:02.246039 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:02.246471 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:02.247188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:02.247732 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:02.248245 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:02.281574 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:02.282086 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:02.282508 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:02.282938 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lazy-loading 'fault' on Instance uuid 4fd1cfcf-9901-4c50-b164-3ea5d344df43 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:47:02.324627 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:02.332867 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-e74de5bd-40fc-4bb0-ba77-d1161601e90d tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 200 len: 1229 microversion: 2.1 time: 0.099013 Aug 23 04:47:02.333478 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 553/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:02 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:47:03.356836 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:03.357727 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 4fd1cfcf-9901-4c50-b164-3ea5d344df43] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:03.364861 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:03.365350 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:03.365778 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:03.366465 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:03.366925 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:03.367387 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:03.382553 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] HTTP exception thrown: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Request method failure captured: Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 HTTP/1.1 Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFpBsDV_t3q5LYvtkIyp96DmrfZioPpwlVWZ3Rcv0fYs0mJvJsImZU5iR0gSlvyoaFA69ZnCt1yelHxGwjHKvc9YHJWJYI8x12RLYWZbCVYSy01Rv7BrxL07LJbkTMjTKATPbhY083PiRbiAJUpYSAcsC_D7v4eUyU9tG4FqJtniCAQ Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:47:03.384203 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65e721c90c8d41088ec9f9d92dd5858d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 041280e59ffa4e518a599442fe9ded41 Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. Aug 23 04:47:03.385818 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '4fd1cfcf-9901-4c50-b164-3ea5d344df43'} Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:47:03.386969 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. Aug 23 04:47:03.389212 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:03.391200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Returning 404 to user: Instance 4fd1cfcf-9901-4c50-b164-3ea5d344df43 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:47:03.391200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-883e52b6-ec2e-4cb2-84d9-3b0733489e99 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43" status: 404 len: 111 microversion: 2.1 time: 0.033682 Aug 23 04:47:03.391200 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 524/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:03 2022] GET /compute/v2.1/servers/4fd1cfcf-9901-4c50-b164-3ea5d344df43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:47:06.509936 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d986b25-967a-4826-acec-41d417b05879", "tag": "cd10355d-64db-4077-8d08-9436826aea73"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:47:06.515558 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:06.516060 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:06.522656 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:06.523147 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:06.523578 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:06.524304 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:06.524751 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:06.525168 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:06.525671 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:06.526195 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:06.526672 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:06.538358 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] Creating event network-changed:cd10355d-64db-4077-8d08-9436826aea73 for instance 6d986b25-967a-4826-acec-41d417b05879 on hv-cinder-85407 Aug 23 04:47:06.543445 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-e8d9d038-5b5b-495c-af53-a1e99991252d req-6a0a9a29-6bc0-484e-97f4-eb83e326eeb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037238 Aug 23 04:47:06.544560 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 525/1078] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:47:06.554463 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Going to try to terminate instance {{(pid=121223) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 04:47:06.640204 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-ce1c2b63-b465-4063-941a-71ccc8e28800 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 204 len: 0 microversion: 2.1 time: 0.135577 Aug 23 04:47:06.644839 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 554/1079] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:47:06 2022] DELETE /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 04:47:06.650064 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:06.650876 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:06.657699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:06.658178 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:06.658604 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:06.659287 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:06.659920 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:06.660347 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:06.815696 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.policy [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121224) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:06.824100 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-62694d76-93dc-4814-a65e-96e62aaaa1ab tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1575 microversion: 2.1 time: 0.178535 Aug 23 04:47:06.824631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 526/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:06 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 04:47:07.846143 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:07.846842 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:07.854107 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:07.854590 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:07.855024 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:07.855726 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:07.856188 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:07.856638 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:08.086794 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:08.095292 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-45ae4e1c-79de-42a5-a931-1f7663637c6a tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1575 microversion: 2.1 time: 0.253577 Aug 23 04:47:08.095956 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 555/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:07 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:47:08.555959 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d986b25-967a-4826-acec-41d417b05879", "name": "network-vif-deleted", "tag": "cd10355d-64db-4077-8d08-9436826aea73"}]} {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 04:47:08.567575 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:08.568119 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:08.568552 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:08.581177 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.compute.server_external_events [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] Creating event network-vif-deleted:cd10355d-64db-4077-8d08-9436826aea73 for instance 6d986b25-967a-4826-acec-41d417b05879 on hv-cinder-85407 Aug 23 04:47:08.586806 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [req-79989ae7-d313-492e-a154-95e4e848098c req-bb24beda-f60e-4305-a6ca-574475d086a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034616 Aug 23 04:47:08.587404 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 527/1082] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Aug 23 04:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 04:47:09.117439 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:09.118065 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:09.125370 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:09.125874 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:09.126300 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:09.127203 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:09.127668 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:09.128112 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:09.159487 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:09.159997 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:09.160420 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:09.160855 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.objects.instance [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lazy-loading 'fault' on Instance uuid 6d986b25-967a-4826-acec-41d417b05879 {{(pid=121223) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 04:47:09.203276 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.policy [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041280e59ffa4e518a599442fe9ded41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e721c90c8d41088ec9f9d92dd5858d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121223) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 04:47:09.210632 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-7c451dfd-0c67-4066-9d39-0f78bdf5e63c tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 200 len: 1182 microversion: 2.1 time: 0.097619 Aug 23 04:47:09.211418 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 556/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:09 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 1182 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 04:47:10.234236 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:10.235000 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: 6d986b25-967a-4826-acec-41d417b05879] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:10.242717 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.243223 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.243667 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.244421 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.244888 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.245325 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.260484 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] HTTP exception thrown: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Request method failure captured: Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 HTTP/1.1 Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFpBsDV_t3q5LYvtkIyp96DmrfZioPpwlVWZ3Rcv0fYs0mJvJsImZU5iR0gSlvyoaFA69ZnCt1yelHxGwjHKvc9YHJWJYI8x12RLYWZbCVYSy01Rv7BrxL07LJbkTMjTKATPbhY083PiRbiAJUpYSAcsC_D7v4eUyU9tG4FqJtniCAQ Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:47:10.262362 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65e721c90c8d41088ec9f9d92dd5858d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 041280e59ffa4e518a599442fe9ded41 Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. Aug 23 04:47:10.264313 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': '6d986b25-967a-4826-acec-41d417b05879'} Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:47:10.265654 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. Aug 23 04:47:10.267276 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.269052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Returning 404 to user: Instance 6d986b25-967a-4826-acec-41d417b05879 could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:47:10.269052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-adfe0336-2e0e-4e16-b960-43c54c3783f6 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879" status: 404 len: 111 microversion: 2.1 time: 0.034185 Aug 23 04:47:10.269052 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 528/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:10 2022] GET /compute/v2.1/servers/6d986b25-967a-4826-acec-41d417b05879 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:47:10.723313 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:10.723875 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.compute.api [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121223) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:10.730966 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.731444 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.731877 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.732600 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.733047 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.733465 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG oslo_concurrency.lockutils [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.747680 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.wsgi [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] HTTP exception thrown: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Request method failure captured: Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: request: DELETE /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec HTTP/1.1 Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept: application/json Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Accept-Encoding: identity Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Connection: close Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Length: 0 Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Content-Type: application/json Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Host: 10.222.0.18 Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Openstack-System-Scope: None Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: User-Agent: python-urllib3/1.26.11 Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Auth-Token: gAAAAABjBFpBsDV_t3q5LYvtkIyp96DmrfZioPpwlVWZ3Rcv0fYs0mJvJsImZU5iR0gSlvyoaFA69ZnCt1yelHxGwjHKvc9YHJWJYI8x12RLYWZbCVYSy01Rv7BrxL07LJbkTMjTKATPbhY083PiRbiAJUpYSAcsC_D7v4eUyU9tG4FqJtniCAQ Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Id: None Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Domain-Name: None Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Identity-Status: Confirmed Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Is-Admin-Project: True Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Id: default Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Domain-Name: Default Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Project-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Role: reader,member Aug 23 04:47:10.749386 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Roles: reader,member Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65e721c90c8d41088ec9f9d92dd5858d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-Tenant-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Id: default Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Domain-Name: Default Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Id: 041280e59ffa4e518a599442fe9ded41 Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: X-User-Name: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: method: > Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: exception: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.750963 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: action_args: {'id': 'b57416f1-6a5d-4929-86a5-791ae15f40ec'} Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:47:10.751772 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.753218 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.754813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Returning 404 to user: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. {{(pid=121223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:47:10.754813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-40ef3e08-3247-44aa-881b-ed3aa0d31876 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 404 len: 111 microversion: 2.1 time: 0.033382 Aug 23 04:47:10.754813 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 557/1085] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Aug 23 04:47:10 2022] DELETE /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:47:10.760460 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '>' {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:10.761074 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.compute.api [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] [instance: b57416f1-6a5d-4929-86a5-791ae15f40ec] Fetching instance by UUID {{(pid=121224) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 04:47:10.767453 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.768159 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.768482 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.769164 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Acquiring lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 04:47:10.769613 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 04:47:10.770012 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG oslo_concurrency.lockutils [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Lock "101fad6b-7e6e-45d6-8875-d41a29e76ec7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 04:47:10.784664 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.wsgi [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] HTTP exception thrown: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Request method failure captured: Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: request: GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec HTTP/1.1 Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept: application/json Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Accept-Encoding: identity Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Connection: close Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Length: 0 Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Content-Type: application/json Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Host: 10.222.0.18 Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Openstack-System-Scope: None Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: User-Agent: python-urllib3/1.26.11 Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Auth-Token: gAAAAABjBFpBsDV_t3q5LYvtkIyp96DmrfZioPpwlVWZ3Rcv0fYs0mJvJsImZU5iR0gSlvyoaFA69ZnCt1yelHxGwjHKvc9YHJWJYI8x12RLYWZbCVYSy01Rv7BrxL07LJbkTMjTKATPbhY083PiRbiAJUpYSAcsC_D7v4eUyU9tG4FqJtniCAQ Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Id: None Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Domain-Name: None Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Identity-Status: Confirmed Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Is-Admin-Project: True Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Id: default Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Domain-Name: Default Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Project-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Role: reader,member Aug 23 04:47:10.786188 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Roles: reader,member Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65e721c90c8d41088ec9f9d92dd5858d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65e721c90c8d41088ec9f9d92dd5858d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Id: 65e721c90c8d41088ec9f9d92dd5858d Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-Tenant-Name: tempest-TestVolumeBootPattern-312866803 Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Id: default Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Domain-Name: Default Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Id: 041280e59ffa4e518a599442fe9ded41 Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: X-User-Name: tempest-TestVolumeBootPattern-312866803-project Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: method: > Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: exception: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.787793 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: action_args: {'id': 'b57416f1-6a5d-4929-86a5-791ae15f40ec'} Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: {{(pid=121224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 04:47:10.789023 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. Aug 23 04:47:10.790631 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: ERROR nova.api.openstack.wsgi Aug 23 04:47:10.792041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: DEBUG nova.api.openstack.wsgi [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Returning 404 to user: Instance b57416f1-6a5d-4929-86a5-791ae15f40ec could not be found. {{(pid=121224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 04:47:10.792041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO nova.api.openstack.requestlog [None req-acb6ea93-28ce-4a9b-943b-04a0b484a578 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec" status: 404 len: 111 microversion: 2.1 time: 0.031015 Aug 23 04:47:10.792041 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: [pid: 121224|app: 0|req: 529/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Aug 23 04:47:10 2022] GET /compute/v2.1/servers/b57416f1-6a5d-4929-86a5-791ae15f40ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 04:47:12.109799 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: DEBUG nova.api.openstack.wsgi [None req-296f8f46-8bf3-4a19-9369-5dd0e3076733 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] Calling method '.version_select at 0x7f9c16ffc0d0>' {{(pid=121223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 04:47:12.132673 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO nova.api.openstack.requestlog [None req-296f8f46-8bf3-4a19-9369-5dd0e3076733 tempest-TestVolumeBootPattern-312866803 tempest-TestVolumeBootPattern-312866803-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-759400215" status: 202 len: 0 microversion: 2.1 time: 0.026881 Aug 23 04:47:12.136606 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: [pid: 121223|app: 0|req: 558/1087] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Aug 23 04:47:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-759400215 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 04:47:36.708148 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:47:36.708787 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:47:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:49:05.717171 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:49:05.718054 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:49:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:49:16.729699 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:49:16.730921 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:49:34.444729 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:49:34.445709 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:49:40.639506 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:49:40.640353 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:50:56.718876 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:50:56.720073 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:52:25.730346 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:52:25.730975 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:52:31.392747 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:52:31.393626 dv-cinder-854070-1-iscsi devstack@n-api.service[121223]: Tue Aug 23 04:52:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 04:52:36.742335 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 04:52:36.743210 dv-cinder-854070-1-iscsi devstack@n-api.service[121224]: Tue Aug 23 04:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!